Total runs:
279.8K
Run Growth:
2.7K
Growth Rate:
0.96%
hfl / llama-3-chinese-8b-instruct-v2-gguf
Model's Last Updated: May 13 2024
Introduction of llama-3-chinese-8b-instruct-v2-gguf
Model Details of llama-3-chinese-8b-instruct-v2-gguf
Llama-3-Chinese-8B-Instruct-v2-GGUF
This repository contains Llama-3-Chinese-8B-Instruct-v2-GGUF (llama.cpp/ollama/tgw, etc. compatible), which is the quantized version of Llama-3-Chinese-8B-Instruct-v2 .
Note: this is an instruction (chat) model, which can be used for conversation, QA, etc.
Further details (performance, usage, etc.) should refer to GitHub project page: https://github.com/ymcui/Chinese-LLaMA-Alpaca-3
Performance
Metric: PPL, lower is better
Note: PPL for v2 models are higher than v1, as the v2's base model (Meta-Llama-3-8B-Instruct) also has a larger PPL than v1's (Meta-Llama-3-8B).
| Quant | Size | PPL |
|---|---|---|
| Q2_K | 2.96 GB | 13.2488 +/- 0.17217 |
| Q3_K | 3.74 GB | 6.9618 +/- 0.08420 |
| Q4_0 | 4.34 GB | 6.8925 +/- 0.08437 |
| Q4_K | 4.58 GB | 6.4851 +/- 0.07892 |
| Q5_0 | 5.21 GB | 6.4608 +/- 0.07862 |
| Q5_K | 5.34 GB | 6.3742 +/- 0.07740 |
| Q6_K | 6.14 GB | 6.3494 +/- 0.07703 |
| Q8_0 | 7.95 GB | 6.3110 +/- 0.07673 |
| F16 | 14.97 GB | 6.3005 +/- 0.07658 |
Others
-
For full model, please see: https://huggingface.co/hfl/llama-3-chinese-8b-instruct-v2
-
For LoRA-only model, please see: https://huggingface.co/hfl/llama-3-chinese-8b-instruct-v2-lora
-
If you have questions/issues regarding this model, please submit an issue through https://github.com/ymcui/Chinese-LLaMA-Alpaca-3
Runs of hfl llama-3-chinese-8b-instruct-v2-gguf on huggingface.co
258
Total runs
-9
24-hour runs
-22
3-day runs
-30
7-day runs
-234
30-day runs
More Information About llama-3-chinese-8b-instruct-v2-gguf huggingface.co Model
Url of llama-3-chinese-8b-instruct-v2-gguf
llama-3-chinese-8b-instruct-v2-gguf huggingface.co Url
Provider of llama-3-chinese-8b-instruct-v2-gguf huggingface.co
Other API from hfl
Updated: March 01 2022
Total runs:
6.1K
Run Growth:
-5.7K
Growth Rate:
-92.81%
Total runs:
5.8K
Run Growth:
-1.7K
Growth Rate:
-29.08%
Total runs:
5.3K
Run Growth:
-1.2K
Growth Rate:
-21.90%
Total runs:
2.9K
Run Growth:
421
Growth Rate:
14.67%
Total runs:
2.2K
Run Growth:
-400
Growth Rate:
-18.15%
Total runs:
1.3K
Run Growth:
-8.7K
Growth Rate:
-677.19%
Total runs:
1.3K
Run Growth:
515
Growth Rate:
40.30%
Total runs:
1.2K
Run Growth:
1
Growth Rate:
0.09%
Total runs:
1.1K
Run Growth:
724
Growth Rate:
67.66%
Total runs:
1.0K
Run Growth:
-190
Growth Rate:
-18.45%
Total runs:
1.0K
Run Growth:
-57
Growth Rate:
-5.68%
Total runs:
958
Run Growth:
-142
Growth Rate:
-14.82%
Total runs:
939
Run Growth:
-24
Growth Rate:
-2.56%
Total runs:
882
Run Growth:
238
Growth Rate:
26.98%
Total runs:
699
Run Growth:
-706
Growth Rate:
-101.00%
Total runs:
688
Run Growth:
677
Growth Rate:
98.40%
Total runs:
581
Run Growth:
-476
Growth Rate:
-81.93%
Total runs:
559
Run Growth:
331
Growth Rate:
59.21%
Total runs:
526
Run Growth:
-510
Growth Rate:
-96.96%
Total runs:
462
Run Growth:
-46
Growth Rate:
-9.96%
Total runs:
428
Run Growth:
-52
Growth Rate:
-12.15%
Total runs:
419
Run Growth:
252
Growth Rate:
60.14%
Total runs:
415
Run Growth:
281
Growth Rate:
67.71%
Total runs:
400
Run Growth:
128
Growth Rate:
32.00%
Total runs:
333
Run Growth:
194
Growth Rate:
58.26%
Total runs:
328
Run Growth:
169
Growth Rate:
51.52%
Total runs:
286
Run Growth:
1
Growth Rate:
0.35%
Total runs:
279
Run Growth:
181
Growth Rate:
64.87%
Total runs:
237
Run Growth:
-36
Growth Rate:
-15.19%
Total runs:
220
Run Growth:
83
Growth Rate:
37.73%
Total runs:
219
Run Growth:
-57
Growth Rate:
-26.03%
Total runs:
219
Run Growth:
-99
Growth Rate:
-45.21%
Total runs:
207
Run Growth:
62
Growth Rate:
29.95%
Total runs:
183
Run Growth:
-19
Growth Rate:
-10.38%
Total runs:
179
Run Growth:
-240
Growth Rate:
-134.08%
Total runs:
171
Run Growth:
-172
Growth Rate:
-100.58%
Total runs:
163
Run Growth:
-15.4K
Growth Rate:
-9465.64%
Total runs:
150
Run Growth:
48
Growth Rate:
32.00%
Total runs:
143
Run Growth:
28
Growth Rate:
19.58%
Total runs:
110
Run Growth:
99
Growth Rate:
90.00%
Total runs:
95
Run Growth:
28
Growth Rate:
29.47%
Total runs:
88
Run Growth:
-440
Growth Rate:
-500.00%
Total runs:
75
Run Growth:
-697
Growth Rate:
-929.33%
Total runs:
59
Run Growth:
47
Growth Rate:
79.66%
Total runs:
22
Run Growth:
7
Growth Rate:
31.82%
Total runs:
16
Run Growth:
-3
Growth Rate:
-18.75%
Total runs:
16
Run Growth:
-2
Growth Rate:
-12.50%
Total runs:
14
Run Growth:
-3
Growth Rate:
-21.43%
Total runs:
13
Run Growth:
-8
Growth Rate:
-61.54%
Total runs:
12
Run Growth:
-34
Growth Rate:
-283.33%
Total runs:
11
Run Growth:
2
Growth Rate:
18.18%
Total runs:
11
Run Growth:
-52
Growth Rate:
-472.73%
Total runs:
10
Run Growth:
-6
Growth Rate:
-60.00%
Total runs:
10
Run Growth:
-2
Growth Rate:
-20.00%
Total runs:
10
Run Growth:
0
Growth Rate:
0.00%
Total runs:
10
Run Growth:
-7
Growth Rate:
-70.00%
Total runs:
9
Run Growth:
-2
Growth Rate:
-22.22%
Total runs:
8
Run Growth:
-9
Growth Rate:
-112.50%
Total runs:
7
Run Growth:
-28
Growth Rate:
-400.00%
Total runs:
7
Run Growth:
-4
Growth Rate:
-57.14%
Total runs:
7
Run Growth:
-6
Growth Rate:
-85.71%
Total runs:
6
Run Growth:
-7
Growth Rate:
-116.67%
Total runs:
5
Run Growth:
-35
Growth Rate:
-700.00%
Total runs:
3
Run Growth:
-43
Growth Rate:
-1433.33%
Total runs:
3
Run Growth:
-4
Growth Rate:
-133.33%
Total runs:
2
Run Growth:
-7
Growth Rate:
-350.00%
Total runs:
2
Run Growth:
-6
Growth Rate:
-300.00%