hfl / llama-3-chinese-8b-instruct-gguf

huggingface.co
Total runs: 1.3K
24-hour runs: 410
7-day runs: 455
30-day runs: 515
Model's Last Updated: Avril 30 2024

Introduction of llama-3-chinese-8b-instruct-gguf

Model Details of llama-3-chinese-8b-instruct-gguf

Llama-3-Chinese-8B-Instruct-GGUF

This repository contains Llama-3-Chinese-8B-Instruct-GGUF (llama.cpp/ollama/tgw, etc. compatible), which is the quantized version of Llama-3-Chinese-8B-Instruct .

Note: this is an instruction (chat) model, which can be used for conversation, QA, etc.

Further details (performance, usage, etc.) should refer to GitHub project page: https://github.com/ymcui/Chinese-LLaMA-Alpaca-3

Performance

Metric: PPL, lower is better

Note: Old models have been removed due to its inferior performance (llama.cpp has breaking changes on pre-tokenizer).

Quant Size PPL (old model) 👍🏻 PPL (new model)
Q2_K 2.96 GB 10.3918 +/- 0.13288 9.1168 +/- 0.10711
Q3_K 3.74 GB 6.3018 +/- 0.07849 5.4082 +/- 0.05955
Q4_0 4.34 GB 6.0628 +/- 0.07501 5.2048 +/- 0.05725
Q4_K 4.58 GB 5.9066 +/- 0.07419 5.0189 +/- 0.05520
Q5_0 5.21 GB 5.8562 +/- 0.07355 4.9803 +/- 0.05493
Q5_K 5.34 GB 5.8062 +/- 0.07331 4.9195 +/- 0.05436
Q6_K 6.14 GB 5.7757 +/- 0.07298 4.8966 +/- 0.05413
Q8_0 7.95 GB 5.7626 +/- 0.07272 4.8822 +/- 0.05396
F16 14.97 GB 5.7628 +/- 0.07275 4.8802 +/- 0.05392
Others

Runs of hfl llama-3-chinese-8b-instruct-gguf on huggingface.co

1.3K
Total runs
410
24-hour runs
361
3-day runs
455
7-day runs
515
30-day runs

More Information About llama-3-chinese-8b-instruct-gguf huggingface.co Model

More llama-3-chinese-8b-instruct-gguf license Visit here:

https://choosealicense.com/licenses/apache-2.0

llama-3-chinese-8b-instruct-gguf huggingface.co

llama-3-chinese-8b-instruct-gguf huggingface.co is an AI model on huggingface.co that provides llama-3-chinese-8b-instruct-gguf's model effect (), which can be used instantly with this hfl llama-3-chinese-8b-instruct-gguf model. huggingface.co supports a free trial of the llama-3-chinese-8b-instruct-gguf model, and also provides paid use of the llama-3-chinese-8b-instruct-gguf. Support call llama-3-chinese-8b-instruct-gguf model through api, including Node.js, Python, http.

llama-3-chinese-8b-instruct-gguf huggingface.co Url

https://huggingface.co/hfl/llama-3-chinese-8b-instruct-gguf

hfl llama-3-chinese-8b-instruct-gguf online free

llama-3-chinese-8b-instruct-gguf huggingface.co is an online trial and call api platform, which integrates llama-3-chinese-8b-instruct-gguf's modeling effects, including api services, and provides a free online trial of llama-3-chinese-8b-instruct-gguf, you can try llama-3-chinese-8b-instruct-gguf online for free by clicking the link below.

hfl llama-3-chinese-8b-instruct-gguf online free url in huggingface.co:

https://huggingface.co/hfl/llama-3-chinese-8b-instruct-gguf

llama-3-chinese-8b-instruct-gguf install

llama-3-chinese-8b-instruct-gguf is an open source model from GitHub that offers a free installation service, and any user can find llama-3-chinese-8b-instruct-gguf on GitHub to install. At the same time, huggingface.co provides the effect of llama-3-chinese-8b-instruct-gguf install, users can directly use llama-3-chinese-8b-instruct-gguf installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

llama-3-chinese-8b-instruct-gguf install url in huggingface.co:

https://huggingface.co/hfl/llama-3-chinese-8b-instruct-gguf

Url of llama-3-chinese-8b-instruct-gguf

llama-3-chinese-8b-instruct-gguf huggingface.co Url

Provider of llama-3-chinese-8b-instruct-gguf huggingface.co

hfl
ORGANIZATIONS

Other API from hfl

huggingface.co

Total runs: 49.6K
Run Growth: 14.1K
Growth Rate: 28.95%
Updated: Mai 19 2021
huggingface.co

Total runs: 4.3K
Run Growth: 278
Growth Rate: 6.40%
Updated: Mai 19 2021
huggingface.co

Total runs: 939
Run Growth: -48
Growth Rate: -5.11%
Updated: Mars 05 2024
huggingface.co

Total runs: 346
Run Growth: -417
Growth Rate: -120.52%
Updated: Novembre 15 2022
huggingface.co

Total runs: 260
Run Growth: -131
Growth Rate: -50.38%
Updated: Mai 19 2021
huggingface.co

Total runs: 151
Run Growth: 32
Growth Rate: 21.19%
Updated: Janvier 24 2022
huggingface.co

Total runs: 134
Run Growth: 71
Growth Rate: 52.99%
Updated: Février 24 2022
huggingface.co

Total runs: 118
Run Growth: 11
Growth Rate: 9.32%
Updated: Novembre 15 2022
huggingface.co

Total runs: 102
Run Growth: -226
Growth Rate: -221.57%
Updated: Mai 19 2021
huggingface.co

Total runs: 53
Run Growth: -51
Growth Rate: -92.73%
Updated: Novembre 17 2022
huggingface.co

Total runs: 26
Run Growth: 7
Growth Rate: 26.92%
Updated: Février 21 2022
huggingface.co

Total runs: 20
Run Growth: -10
Growth Rate: -50.00%
Updated: Janvier 24 2022
huggingface.co

Total runs: 19
Run Growth: -10
Growth Rate: -52.63%
Updated: Novembre 15 2022
huggingface.co

Total runs: 13
Run Growth: -40
Growth Rate: -307.69%
Updated: Janvier 24 2022
huggingface.co

Total runs: 9
Run Growth: -6
Growth Rate: -66.67%
Updated: Mai 19 2021
huggingface.co

Total runs: 7
Run Growth: 0
Growth Rate: 0.00%
Updated: Mars 09 2023
huggingface.co

Total runs: 5
Run Growth: -1
Growth Rate: -20.00%
Updated: Mars 09 2023