Total runs:
276.2K
Run Growth:
174
Growth Rate:
0.06%
hfl / llama-3-chinese-8b-instruct-gguf
Model's Last Updated: April 30 2024
Introduction of llama-3-chinese-8b-instruct-gguf
Model Details of llama-3-chinese-8b-instruct-gguf
Llama-3-Chinese-8B-Instruct-GGUF
This repository contains Llama-3-Chinese-8B-Instruct-GGUF (llama.cpp/ollama/tgw, etc. compatible), which is the quantized version of Llama-3-Chinese-8B-Instruct .
Note: this is an instruction (chat) model, which can be used for conversation, QA, etc.
Further details (performance, usage, etc.) should refer to GitHub project page: https://github.com/ymcui/Chinese-LLaMA-Alpaca-3
Performance
Metric: PPL, lower is better
Note: Old models have been removed due to its inferior performance (llama.cpp has breaking changes on pre-tokenizer).
| Quant | Size | PPL (old model) | 👍🏻 PPL (new model) |
|---|---|---|---|
| Q2_K | 2.96 GB | 10.3918 +/- 0.13288 | 9.1168 +/- 0.10711 |
| Q3_K | 3.74 GB | 6.3018 +/- 0.07849 | 5.4082 +/- 0.05955 |
| Q4_0 | 4.34 GB | 6.0628 +/- 0.07501 | 5.2048 +/- 0.05725 |
| Q4_K | 4.58 GB | 5.9066 +/- 0.07419 | 5.0189 +/- 0.05520 |
| Q5_0 | 5.21 GB | 5.8562 +/- 0.07355 | 4.9803 +/- 0.05493 |
| Q5_K | 5.34 GB | 5.8062 +/- 0.07331 | 4.9195 +/- 0.05436 |
| Q6_K | 6.14 GB | 5.7757 +/- 0.07298 | 4.8966 +/- 0.05413 |
| Q8_0 | 7.95 GB | 5.7626 +/- 0.07272 | 4.8822 +/- 0.05396 |
| F16 | 14.97 GB | 5.7628 +/- 0.07275 | 4.8802 +/- 0.05392 |
Others
-
For full model, please see: https://huggingface.co/hfl/llama-3-chinese-8b-instruct
-
For LoRA-only model, please see: https://huggingface.co/hfl/llama-3-chinese-8b-instruct-lora
-
If you have questions/issues regarding this model, please submit an issue through https://github.com/ymcui/Chinese-LLaMA-Alpaca-3
Runs of hfl llama-3-chinese-8b-instruct-gguf on huggingface.co
1.1K
Total runs
-81
24-hour runs
250
3-day runs
201
7-day runs
209
30-day runs
More Information About llama-3-chinese-8b-instruct-gguf huggingface.co Model
Url of llama-3-chinese-8b-instruct-gguf
llama-3-chinese-8b-instruct-gguf huggingface.co Url
Provider of llama-3-chinese-8b-instruct-gguf huggingface.co
Other API from hfl
Updated: March 01 2022
Total runs:
5.6K
Run Growth:
-1.8K
Growth Rate:
-32.08%
Total runs:
5.2K
Run Growth:
-3.6K
Growth Rate:
-69.57%
Total runs:
4.8K
Run Growth:
-2.0K
Growth Rate:
-41.07%
Total runs:
2.6K
Run Growth:
-275
Growth Rate:
-10.49%
Total runs:
2.1K
Run Growth:
-534
Growth Rate:
-25.13%
Total runs:
1.3K
Run Growth:
-8.7K
Growth Rate:
-685.95%
Total runs:
1.3K
Run Growth:
173
Growth Rate:
13.80%
Total runs:
1.1K
Run Growth:
-16
Growth Rate:
-1.42%
Total runs:
1.1K
Run Growth:
130
Growth Rate:
11.71%
Total runs:
1.1K
Run Growth:
749
Growth Rate:
69.48%
Total runs:
1.0K
Run Growth:
151
Growth Rate:
14.62%
Total runs:
977
Run Growth:
410
Growth Rate:
41.97%
Total runs:
853
Run Growth:
-391
Growth Rate:
-45.84%
Total runs:
688
Run Growth:
677
Growth Rate:
98.40%
Total runs:
622
Run Growth:
-700
Growth Rate:
-112.54%
Total runs:
509
Run Growth:
236
Growth Rate:
46.37%
Total runs:
495
Run Growth:
-649
Growth Rate:
-131.11%
Total runs:
445
Run Growth:
-49
Growth Rate:
-11.01%
Total runs:
424
Run Growth:
276
Growth Rate:
65.09%
Total runs:
421
Run Growth:
-678
Growth Rate:
-161.05%
Total runs:
417
Run Growth:
248
Growth Rate:
59.47%
Total runs:
414
Run Growth:
154
Growth Rate:
37.20%
Total runs:
407
Run Growth:
-63
Growth Rate:
-15.48%
Total runs:
353
Run Growth:
197
Growth Rate:
58.11%
Total runs:
319
Run Growth:
161
Growth Rate:
50.47%
Total runs:
315
Run Growth:
3
Growth Rate:
1.01%
Total runs:
272
Run Growth:
168
Growth Rate:
61.76%
Total runs:
245
Run Growth:
-26
Growth Rate:
-10.61%
Total runs:
240
Run Growth:
-254
Growth Rate:
-105.83%
Total runs:
219
Run Growth:
90
Growth Rate:
41.10%
Total runs:
219
Run Growth:
-54
Growth Rate:
-24.66%
Total runs:
207
Run Growth:
75
Growth Rate:
36.23%
Total runs:
198
Run Growth:
-135
Growth Rate:
-68.18%
Total runs:
186
Run Growth:
22
Growth Rate:
11.83%
Total runs:
176
Run Growth:
-164
Growth Rate:
-93.18%
Total runs:
175
Run Growth:
-26
Growth Rate:
-14.86%
Total runs:
159
Run Growth:
67
Growth Rate:
42.14%
Total runs:
146
Run Growth:
52
Growth Rate:
35.62%
Total runs:
123
Run Growth:
-15.5K
Growth Rate:
-12601.63%
Total runs:
109
Run Growth:
97
Growth Rate:
88.99%
Total runs:
94
Run Growth:
25
Growth Rate:
26.60%
Total runs:
83
Run Growth:
-430
Growth Rate:
-518.07%
Total runs:
74
Run Growth:
-475
Growth Rate:
-641.89%
Total runs:
58
Run Growth:
45
Growth Rate:
77.59%
Total runs:
30
Run Growth:
-18
Growth Rate:
-60.00%
Total runs:
22
Run Growth:
7
Growth Rate:
31.82%
Total runs:
16
Run Growth:
-2
Growth Rate:
-12.50%
Total runs:
14
Run Growth:
-7
Growth Rate:
-50.00%
Total runs:
14
Run Growth:
-3
Growth Rate:
-21.43%
Total runs:
10
Run Growth:
-1
Growth Rate:
-10.00%
Total runs:
10
Run Growth:
-5
Growth Rate:
-50.00%
Total runs:
10
Run Growth:
-54
Growth Rate:
-540.00%
Total runs:
10
Run Growth:
-37
Growth Rate:
-370.00%
Total runs:
9
Run Growth:
-3
Growth Rate:
-33.33%
Total runs:
9
Run Growth:
-16
Growth Rate:
-177.78%
Total runs:
8
Run Growth:
-10
Growth Rate:
-125.00%
Total runs:
8
Run Growth:
-8
Growth Rate:
-100.00%
Total runs:
8
Run Growth:
-3
Growth Rate:
-37.50%
Total runs:
8
Run Growth:
-4
Growth Rate:
-50.00%
Total runs:
7
Run Growth:
-12
Growth Rate:
-171.43%
Total runs:
7
Run Growth:
-6
Growth Rate:
-85.71%
Total runs:
6
Run Growth:
-6
Growth Rate:
-100.00%
Total runs:
5
Run Growth:
-8
Growth Rate:
-160.00%
Total runs:
4
Run Growth:
-37
Growth Rate:
-925.00%
Total runs:
3
Run Growth:
-43
Growth Rate:
-1433.33%
Total runs:
3
Run Growth:
-4
Growth Rate:
-133.33%
Total runs:
2
Run Growth:
-6
Growth Rate:
-300.00%
Total runs:
1
Run Growth:
-9
Growth Rate:
-900.00%