Total runs:
99.0K
Run Growth:
96.4K
Growth Rate:
97.30%
second-state / Llama-3-8B-Instruct-GGUF
Model's Last Updated: July 19 2024
text-generation
Introduction of Llama-3-8B-Instruct-GGUF
Model Details of Llama-3-8B-Instruct-GGUF
Meta-Llama-3-8B-Instruct-GGUF
Original Model
meta-llama/Meta-Llama-3-8B-Instruct
Run with LlamaEdge
-
LlamaEdge version: v0.8.3 and above
-
Prompt template
-
Prompt type:
llama-3-chat -
Prompt string
<|begin_of_text|><|start_header_id|>system<|end_header_id|> {{ system_prompt }}<|eot_id|><|start_header_id|>user<|end_header_id|> {{ user_message_1 }}<|eot_id|><|start_header_id|>assistant<|end_header_id|> {{ model_answer_1 }}<|eot_id|><|start_header_id|>user<|end_header_id|> {{ user_message_2 }}<|eot_id|><|start_header_id|>assistant<|end_header_id|>
-
-
Context size:
8192 -
Run as LlamaEdge service
wasmedge --dir .:. --nn-preload default:GGML:AUTO:Meta-Llama-3-8B-Instruct-Q5_K_M.gguf \ llama-api-server.wasm \ --prompt-template llama-3-chat \ --ctx-size 8192 \ --model-name Llama-3-8b -
Run as LlamaEdge command app
wasmedge --dir .:. --nn-preload default:GGML:AUTO:Meta-Llama-3-8B-Instruct-Q5_K_M.gguf \ llama-chat.wasm \ --prompt-template llama-3-chat \ --ctx-size 8192 \
Quantized GGUF Models
| Name | Quant method | Bits | Size | Use case |
|---|---|---|---|---|
| Meta-Llama-3-8B-Instruct-Q2_K.gguf | Q2_K | 2 | 3.18 GB | smallest, significant quality loss - not recommended for most purposes |
| Meta-Llama-3-8B-Instruct-Q3_K_L.gguf | Q3_K_L | 3 | 4.32 GB | small, substantial quality loss |
| Meta-Llama-3-8B-Instruct-Q3_K_M.gguf | Q3_K_M | 3 | 4.02 GB | very small, high quality loss |
| Meta-Llama-3-8B-Instruct-Q3_K_S.gguf | Q3_K_S | 3 | 3.66 GB | very small, high quality loss |
| Meta-Llama-3-8B-Instruct-Q4_0.gguf | Q4_0 | 4 | 4.66 GB | legacy; small, very high quality loss - prefer using Q3_K_M |
| Meta-Llama-3-8B-Instruct-Q4_K_M.gguf | Q4_K_M | 4 | 4.92 GB | medium, balanced quality - recommended |
| Meta-Llama-3-8B-Instruct-Q4_K_S.gguf | Q4_K_S | 4 | 4.69 GB | small, greater quality loss |
| Meta-Llama-3-8B-Instruct-Q5_0.gguf | Q5_0 | 5 | 5.6 GB | legacy; medium, balanced quality - prefer using Q4_K_M |
| Meta-Llama-3-8B-Instruct-Q5_K_M.gguf | Q5_K_M | 5 | 5.73 GB | large, very low quality loss - recommended |
| Meta-Llama-3-8B-Instruct-Q5_K_S.gguf | Q5_K_S | 5 | 5.6 GB | large, low quality loss - recommended |
| Meta-Llama-3-8B-Instruct-Q6_K.gguf | Q6_K | 6 | 6.6 GB | very large, extremely low quality loss |
| Meta-Llama-3-8B-Instruct-Q8_0.gguf | Q8_0 | 8 | 8.54 GB | very large, extremely low quality loss - not recommended |
| Meta-Llama-3-8B-Instruct-f16.gguf | f16 | 16 | 16.1 GB |
Quantized with llama.cpp b2715.
Runs of second-state Llama-3-8B-Instruct-GGUF on huggingface.co
134
Total runs
0
24-hour runs
-1
3-day runs
-14
7-day runs
-91
30-day runs
More Information About Llama-3-8B-Instruct-GGUF huggingface.co Model
Url of Llama-3-8B-Instruct-GGUF
Llama-3-8B-Instruct-GGUF huggingface.co Url
Provider of Llama-3-8B-Instruct-GGUF huggingface.co
Other API from second-state
Updated: March 20 2024
Total runs:
23.3K
Run Growth:
9.8K
Growth Rate:
42.23%
Total runs:
13.2K
Run Growth:
3.4K
Growth Rate:
25.57%
Total runs:
8.9K
Run Growth:
-273
Growth Rate:
-25.56%
Total runs:
7.0K
Run Growth:
3.1K
Growth Rate:
44.34%
Total runs:
5.7K
Run Growth:
-2.7K
Growth Rate:
-47.69%
Total runs:
4.2K
Run Growth:
3.7K
Growth Rate:
89.53%
Total runs:
2.5K
Run Growth:
1.5K
Growth Rate:
60.80%
Total runs:
2.4K
Run Growth:
1.5K
Growth Rate:
64.21%
Total runs:
1.7K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1.4K
Run Growth:
-691
Growth Rate:
-48.25%
Total runs:
1.4K
Run Growth:
235
Growth Rate:
16.42%
Total runs:
1.3K
Run Growth:
1.1K
Growth Rate:
83.90%
Total runs:
1.2K
Run Growth:
1.7K
Growth Rate:
100.00%
Total runs:
1.2K
Run Growth:
621
Growth Rate:
50.74%
Total runs:
1.2K
Run Growth:
194
Growth Rate:
16.81%
Total runs:
1.1K
Run Growth:
444
Growth Rate:
39.08%
Total runs:
1.1K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1.0K
Run Growth:
997
Growth Rate:
100.00%
Total runs:
987
Run Growth:
146
Growth Rate:
14.79%
Total runs:
969
Run Growth:
519
Growth Rate:
53.56%
Total runs:
935
Run Growth:
695
Growth Rate:
74.33%
Total runs:
876
Run Growth:
-1.6K
Growth Rate:
-181.51%
Total runs:
870
Run Growth:
195
Growth Rate:
22.41%
Total runs:
851
Run Growth:
7
Growth Rate:
0.97%
Total runs:
769
Run Growth:
304
Growth Rate:
39.53%
Total runs:
723
Run Growth:
165
Growth Rate:
100.00%
Total runs:
708
Run Growth:
-3.7K
Growth Rate:
-212.42%
Total runs:
597
Run Growth:
645
Growth Rate:
95.41%
Total runs:
574
Run Growth:
370
Growth Rate:
64.46%
Total runs:
555
Run Growth:
0
Growth Rate:
0.00%
Total runs:
540
Run Growth:
-94
Growth Rate:
-21.66%
Total runs:
535
Run Growth:
69
Growth Rate:
12.90%
Total runs:
527
Run Growth:
0
Growth Rate:
0.00%
Total runs:
521
Run Growth:
378
Growth Rate:
100.00%
Total runs:
511
Run Growth:
276
Growth Rate:
54.12%
Total runs:
506
Run Growth:
-192
Growth Rate:
-37.94%
Total runs:
501
Run Growth:
0
Growth Rate:
0.00%
Total runs:
499
Run Growth:
11
Growth Rate:
2.20%
Total runs:
495
Run Growth:
-50
Growth Rate:
-10.10%
Total runs:
492
Run Growth:
255
Growth Rate:
51.83%
Total runs:
483
Run Growth:
317
Growth Rate:
65.63%
Total runs:
482
Run Growth:
64
Growth Rate:
13.28%
Total runs:
457
Run Growth:
-43
Growth Rate:
-9.41%
Total runs:
429
Run Growth:
2.9K
Growth Rate:
100.00%
Total runs:
427
Run Growth:
278
Growth Rate:
65.11%
Total runs:
415
Run Growth:
286
Growth Rate:
100.00%
Total runs:
403
Run Growth:
0
Growth Rate:
0.00%
Total runs:
402
Run Growth:
114
Growth Rate:
28.36%
Total runs:
370
Run Growth:
0
Growth Rate:
0.00%
Total runs:
364
Run Growth:
-344
Growth Rate:
-264.62%
Total runs:
362
Run Growth:
0
Growth Rate:
0.00%
Total runs:
355
Run Growth:
254
Growth Rate:
100.00%
Total runs:
342
Run Growth:
1.3K
Growth Rate:
100.00%
Total runs:
339
Run Growth:
111
Growth Rate:
32.74%
Total runs:
321
Run Growth:
244
Growth Rate:
100.00%
Total runs:
299
Run Growth:
0
Growth Rate:
0.00%
Total runs:
292
Run Growth:
195
Growth Rate:
66.78%
Total runs:
274
Run Growth:
-15
Growth Rate:
-5.47%
Total runs:
270
Run Growth:
-183
Growth Rate:
-105.17%
Total runs:
269
Run Growth:
0
Growth Rate:
0.00%
Total runs:
259
Run Growth:
549
Growth Rate:
100.00%
Total runs:
256
Run Growth:
-73
Growth Rate:
-28.52%
Total runs:
241
Run Growth:
-122
Growth Rate:
-50.62%
Total runs:
240
Run Growth:
0
Growth Rate:
0.00%
Total runs:
237
Run Growth:
-32
Growth Rate:
-13.50%
Total runs:
235
Run Growth:
-127
Growth Rate:
-54.04%
Total runs:
233
Run Growth:
0
Growth Rate:
0.00%
Total runs:
233
Run Growth:
108
Growth Rate:
46.35%
Total runs:
227
Run Growth:
5
Growth Rate:
2.20%
Total runs:
223
Run Growth:
92
Growth Rate:
41.26%
Total runs:
215
Run Growth:
39
Growth Rate:
18.14%
Total runs:
213
Run Growth:
275
Growth Rate:
100.00%
Total runs:
212
Run Growth:
-73
Growth Rate:
-34.43%
Total runs:
207
Run Growth:
-32
Growth Rate:
-15.46%
Total runs:
205
Run Growth:
1.1K
Growth Rate:
100.00%
Total runs:
204
Run Growth:
50
Growth Rate:
24.51%
Total runs:
201
Run Growth:
33
Growth Rate:
16.42%
Total runs:
199
Run Growth:
-16
Growth Rate:
-8.04%
Total runs:
197
Run Growth:
-30
Growth Rate:
-15.71%
Total runs:
197
Run Growth:
-84
Growth Rate:
-42.64%
Total runs:
197
Run Growth:
49
Growth Rate:
24.87%
Total runs:
191
Run Growth:
43
Growth Rate:
22.51%
Total runs:
190
Run Growth:
8
Growth Rate:
4.21%
Total runs:
190
Run Growth:
-67
Growth Rate:
-35.26%
Total runs:
188
Run Growth:
0
Growth Rate:
0.00%
Total runs:
184
Run Growth:
-676
Growth Rate:
-171.14%
Total runs:
184
Run Growth:
-375
Growth Rate:
-203.80%
Total runs:
181
Run Growth:
23
Growth Rate:
12.71%
Total runs:
181
Run Growth:
-210
Growth Rate:
-116.02%
Total runs:
180
Run Growth:
-21
Growth Rate:
-11.67%
Total runs:
178
Run Growth:
87
Growth Rate:
22.08%
Total runs:
177
Run Growth:
70
Growth Rate:
39.55%
Total runs:
175
Run Growth:
-408
Growth Rate:
-233.14%
Total runs:
174
Run Growth:
-30
Growth Rate:
-17.24%
Total runs:
173
Run Growth:
-147
Growth Rate:
-84.97%
Total runs:
169
Run Growth:
17
Growth Rate:
4.11%
Total runs:
168
Run Growth:
141
Growth Rate:
27.43%
Total runs:
163
Run Growth:
-8
Growth Rate:
-4.91%