hfl / llama-3-chinese-8b-gguf

huggingface.co
Total runs: 320
24-hour runs: -8
7-day runs: 9
30-day runs: 157
Model's Last Updated: April 30 2024

Introduction of llama-3-chinese-8b-gguf

Model Details of llama-3-chinese-8b-gguf

Llama-3-Chinese-8B-GGUF

This repository contains Llama-3-Chinese-8B-GGUF (llama.cpp/ollama/tgw, etc. compatible), which is the quantized version of Llama-3-Chinese-8B .

Note: this is a foundation model, which is not suitable for conversation, QA, etc.

Further details (performance, usage, etc.) should refer to GitHub project page: https://github.com/ymcui/Chinese-LLaMA-Alpaca-3

Performance

Metric: PPL, lower is better

Note: Old models have been removed due to its inferior performance.

Quant Size PPL (old model) 👍🏻 PPL (new model)
Q2_K 2.96 GB 17.7212 +/- 0.59814 11.8595 +/- 0.20061
Q3_K 3.74 GB 8.6303 +/- 0.28481 5.7559 +/- 0.09152
Q4_0 4.34 GB 8.2513 +/- 0.27102 5.5495 +/- 0.08832
Q4_K 4.58 GB 7.8897 +/- 0.25830 5.3126 +/- 0.08500
Q5_0 5.21 GB 7.7975 +/- 0.25639 5.2222 +/- 0.08317
Q5_K 5.34 GB 7.7062 +/- 0.25218 5.1813 +/- 0.08264
Q6_K 6.14 GB 7.6600 +/- 0.25043 5.1481 +/- 0.08205
Q8_0 7.95 GB 7.6512 +/- 0.25064 5.1350 +/- 0.08190
F16 14.97 GB 7.6389 +/- 0.25001 5.1302 +/- 0.08184
Others

Runs of hfl llama-3-chinese-8b-gguf on huggingface.co

320
Total runs
-8
24-hour runs
-17
3-day runs
9
7-day runs
157
30-day runs

More Information About llama-3-chinese-8b-gguf huggingface.co Model

More llama-3-chinese-8b-gguf license Visit here:

https://choosealicense.com/licenses/apache-2.0

llama-3-chinese-8b-gguf huggingface.co

llama-3-chinese-8b-gguf huggingface.co is an AI model on huggingface.co that provides llama-3-chinese-8b-gguf's model effect (), which can be used instantly with this hfl llama-3-chinese-8b-gguf model. huggingface.co supports a free trial of the llama-3-chinese-8b-gguf model, and also provides paid use of the llama-3-chinese-8b-gguf. Support call llama-3-chinese-8b-gguf model through api, including Node.js, Python, http.

llama-3-chinese-8b-gguf huggingface.co Url

https://huggingface.co/hfl/llama-3-chinese-8b-gguf

hfl llama-3-chinese-8b-gguf online free

llama-3-chinese-8b-gguf huggingface.co is an online trial and call api platform, which integrates llama-3-chinese-8b-gguf's modeling effects, including api services, and provides a free online trial of llama-3-chinese-8b-gguf, you can try llama-3-chinese-8b-gguf online for free by clicking the link below.

hfl llama-3-chinese-8b-gguf online free url in huggingface.co:

https://huggingface.co/hfl/llama-3-chinese-8b-gguf

llama-3-chinese-8b-gguf install

llama-3-chinese-8b-gguf is an open source model from GitHub that offers a free installation service, and any user can find llama-3-chinese-8b-gguf on GitHub to install. At the same time, huggingface.co provides the effect of llama-3-chinese-8b-gguf install, users can directly use llama-3-chinese-8b-gguf installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

llama-3-chinese-8b-gguf install url in huggingface.co:

https://huggingface.co/hfl/llama-3-chinese-8b-gguf

Url of llama-3-chinese-8b-gguf

llama-3-chinese-8b-gguf huggingface.co Url

Provider of llama-3-chinese-8b-gguf huggingface.co

hfl
ORGANIZATIONS

Other API from hfl

huggingface.co

Total runs: 49.6K
Run Growth: 14.4K
Growth Rate: 29.04%
Updated: May 19 2021
huggingface.co

Total runs: 4.3K
Run Growth: 185
Growth Rate: 4.34%
Updated: May 19 2021
huggingface.co

Total runs: 986
Run Growth: 35
Growth Rate: 3.55%
Updated: March 05 2024
huggingface.co

Total runs: 361
Run Growth: -407
Growth Rate: -112.74%
Updated: November 15 2022
huggingface.co

Total runs: 254
Run Growth: -138
Growth Rate: -54.33%
Updated: May 19 2021
huggingface.co

Total runs: 151
Run Growth: 32
Growth Rate: 21.19%
Updated: January 24 2022
huggingface.co

Total runs: 134
Run Growth: 74
Growth Rate: 55.22%
Updated: February 24 2022
huggingface.co

Total runs: 90
Run Growth: -264
Growth Rate: -293.33%
Updated: May 19 2021
huggingface.co

Total runs: 81
Run Growth: -63
Growth Rate: -77.78%
Updated: November 15 2022
huggingface.co

Total runs: 53
Run Growth: -48
Growth Rate: -90.57%
Updated: November 17 2022
huggingface.co

Total runs: 26
Run Growth: 8
Growth Rate: 30.77%
Updated: February 21 2022
huggingface.co

Total runs: 20
Run Growth: -10
Growth Rate: -50.00%
Updated: January 24 2022
huggingface.co

Total runs: 19
Run Growth: -10
Growth Rate: -52.63%
Updated: November 15 2022
huggingface.co

Total runs: 13
Run Growth: -39
Growth Rate: -300.00%
Updated: January 24 2022
huggingface.co

Total runs: 7
Run Growth: 1
Growth Rate: 14.29%
Updated: March 09 2023
huggingface.co

Total runs: 7
Run Growth: -10
Growth Rate: -142.86%
Updated: May 19 2021
huggingface.co

Total runs: 7
Run Growth: 1
Growth Rate: 14.29%
Updated: March 09 2023