Total runs:
278.1K
Run Growth:
63.2K
Growth Rate:
22.58%
hfl / llama-3-chinese-8b-instruct-v3-gguf
Model's Last Updated: June 06 2024
Introduction of llama-3-chinese-8b-instruct-v3-gguf
Model Details of llama-3-chinese-8b-instruct-v3-gguf
Llama-3-Chinese-8B-Instruct-v3-GGUF
[👉👉👉 Chat with Llama-3-Chinese-8B-Instruct-v3 @ HF Space]
This repository contains Llama-3-Chinese-8B-Instruct-v3-GGUF (llama.cpp/ollama/tgw, etc. compatible), which is the quantized version of Llama-3-Chinese-8B-Instruct-v3 .
Note: this is an instruction (chat) model, which can be used for conversation, QA, etc.
Further details (performance, usage, etc.) should refer to GitHub project page: https://github.com/ymcui/Chinese-LLaMA-Alpaca-3
Performance
Metric: PPL, lower is better
Note: Unless constrained by memory, we suggest using Q8_0 or Q6_K for better performance.
| Quant | Size | PPL |
|---|---|---|
| Q2_K | 2.96 GB | 10.0534 +/- 0.13135 |
| Q3_K | 3.74 GB | 6.3295 +/- 0.07816 |
| Q4_0 | 4.34 GB | 6.3200 +/- 0.07893 |
| Q4_K | 4.58 GB | 6.0042 +/- 0.07431 |
| Q5_0 | 5.21 GB | 6.0437 +/- 0.07526 |
| Q5_K | 5.34 GB | 5.9484 +/- 0.07399 |
| Q6_K | 6.14 GB | 5.9469 +/- 0.07404 |
| Q8_0 | 7.95 GB | 5.8933 +/- 0.07305 |
| F16 | 14.97 GB | 5.8902 +/- 0.07303 |
Others
- For full model, please see: https://huggingface.co/hfl/llama-3-chinese-8b-instruct-v3
- If you have questions/issues regarding this model, please submit an issue through https://github.com/ymcui/Chinese-LLaMA-Alpaca-3
Runs of hfl llama-3-chinese-8b-instruct-v3-gguf on huggingface.co
2.1K
Total runs
5
24-hour runs
38
3-day runs
-34
7-day runs
110
30-day runs
More Information About llama-3-chinese-8b-instruct-v3-gguf huggingface.co Model
Url of llama-3-chinese-8b-instruct-v3-gguf
llama-3-chinese-8b-instruct-v3-gguf huggingface.co Url
Provider of llama-3-chinese-8b-instruct-v3-gguf huggingface.co
Other API from hfl
Updated: March 01 2022
Total runs:
10.3K
Run Growth:
3.2K
Growth Rate:
31.11%
Total runs:
5.6K
Run Growth:
-581
Growth Rate:
-10.36%
Total runs:
4.4K
Run Growth:
-1.4K
Growth Rate:
-30.48%
Total runs:
4.3K
Run Growth:
-2.8K
Growth Rate:
-65.09%
Total runs:
1.7K
Run Growth:
-1.2K
Growth Rate:
-71.12%
Total runs:
1.6K
Run Growth:
824
Growth Rate:
50.46%
Total runs:
1.5K
Run Growth:
761
Growth Rate:
51.18%
Total runs:
1.5K
Run Growth:
732
Growth Rate:
50.00%
Total runs:
1.4K
Run Growth:
684
Growth Rate:
49.96%
Total runs:
1.3K
Run Growth:
842
Growth Rate:
64.08%
Total runs:
1.2K
Run Growth:
-5.7K
Growth Rate:
-485.15%
Total runs:
985
Run Growth:
134
Growth Rate:
13.60%
Total runs:
688
Run Growth:
682
Growth Rate:
99.13%
Total runs:
562
Run Growth:
421
Growth Rate:
74.91%
Total runs:
539
Run Growth:
-508
Growth Rate:
-94.25%
Total runs:
523
Run Growth:
311
Growth Rate:
59.46%
Total runs:
503
Run Growth:
110
Growth Rate:
21.87%
Total runs:
475
Run Growth:
170
Growth Rate:
49.13%
Total runs:
467
Run Growth:
199
Growth Rate:
42.61%
Total runs:
437
Run Growth:
235
Growth Rate:
53.78%
Total runs:
412
Run Growth:
168
Growth Rate:
40.78%
Total runs:
362
Run Growth:
-12
Growth Rate:
-3.31%
Total runs:
330
Run Growth:
-770
Growth Rate:
-233.33%
Total runs:
327
Run Growth:
176
Growth Rate:
54.49%
Total runs:
299
Run Growth:
75
Growth Rate:
25.08%
Total runs:
261
Run Growth:
132
Growth Rate:
53.66%
Total runs:
250
Run Growth:
-618
Growth Rate:
-247.20%
Total runs:
245
Run Growth:
119
Growth Rate:
48.57%
Total runs:
234
Run Growth:
84
Growth Rate:
35.90%
Total runs:
221
Run Growth:
-172
Growth Rate:
-77.83%
Total runs:
220
Run Growth:
37
Growth Rate:
16.82%
Total runs:
217
Run Growth:
-7
Growth Rate:
-3.23%
Total runs:
214
Run Growth:
-5
Growth Rate:
-2.34%
Total runs:
208
Run Growth:
77
Growth Rate:
37.02%
Total runs:
196
Run Growth:
114
Growth Rate:
58.16%
Total runs:
185
Run Growth:
49
Growth Rate:
26.49%
Total runs:
173
Run Growth:
154
Growth Rate:
89.02%
Total runs:
170
Run Growth:
-115
Growth Rate:
-67.65%
Total runs:
162
Run Growth:
62
Growth Rate:
38.27%
Total runs:
148
Run Growth:
15
Growth Rate:
10.14%
Total runs:
113
Run Growth:
105
Growth Rate:
92.92%
Total runs:
113
Run Growth:
106
Growth Rate:
93.81%
Total runs:
107
Run Growth:
98
Growth Rate:
91.59%
Total runs:
107
Run Growth:
103
Growth Rate:
96.26%
Total runs:
86
Run Growth:
-232
Growth Rate:
-269.77%
Total runs:
82
Run Growth:
22
Growth Rate:
26.83%
Total runs:
74
Run Growth:
-426
Growth Rate:
-575.68%
Total runs:
57
Run Growth:
51
Growth Rate:
89.47%
Total runs:
23
Run Growth:
13
Growth Rate:
56.52%
Total runs:
23
Run Growth:
-32
Growth Rate:
-139.13%
Total runs:
19
Run Growth:
5
Growth Rate:
26.32%
Total runs:
14
Run Growth:
-7
Growth Rate:
-50.00%
Total runs:
13
Run Growth:
-2
Growth Rate:
-15.38%
Total runs:
11
Run Growth:
-3
Growth Rate:
-27.27%
Total runs:
10
Run Growth:
-1
Growth Rate:
-10.00%
Total runs:
10
Run Growth:
-45
Growth Rate:
-450.00%
Total runs:
9
Run Growth:
-10
Growth Rate:
-111.11%
Total runs:
8
Run Growth:
-4
Growth Rate:
-50.00%
Total runs:
8
Run Growth:
-5
Growth Rate:
-62.50%
Total runs:
8
Run Growth:
0
Growth Rate:
0.00%
Total runs:
7
Run Growth:
0
Growth Rate:
0.00%
Total runs:
7
Run Growth:
-2
Growth Rate:
-28.57%
Total runs:
6
Run Growth:
-4
Growth Rate:
-66.67%
Total runs:
6
Run Growth:
-3
Growth Rate:
-50.00%
Total runs:
6
Run Growth:
-1
Growth Rate:
-16.67%
Total runs:
2
Run Growth:
-10
Growth Rate:
-500.00%
Total runs:
1
Run Growth:
-5
Growth Rate:
-500.00%
Total runs:
1
Run Growth:
-39
Growth Rate:
-3900.00%