Total runs:
73.9K
Run Growth:
73.3K
Growth Rate:
99.19%
second-state / Mixtral-8x7B-Instruct-v0.1-GGUF
Model's Last Updated: 2024年3月20日
text-generation
Introduction of Mixtral-8x7B-Instruct-v0.1-GGUF
Model Details of Mixtral-8x7B-Instruct-v0.1-GGUF
Mixtral-8x7B-Instruct-v0.1-GGUF
Original Model
mistralai/Mixtral-8x7B-Instruct-v0.1
Run with LlamaEdge
-
LlamaEdge version: v0.2.8 and above
-
Prompt template
-
Prompt type:
mistral-instruct -
Prompt string
<s> [INST] {user_message_1} [/INST] {assitant_message_1}</s> [INST] {user_message_2} [/INST]
-
-
Context size:
4096 -
Run as LlamaEdge service
wasmedge --dir .:. --nn-preload default:GGML:AUTO:Mixtral-8x7B-Instruct-v0.1-Q5_K_M.gguf llama-api-server.wasm -p mistral-instruct -
Run as LlamaEdge command app
wasmedge --dir .:. --nn-preload default:GGML:AUTO:Mixtral-8x7B-Instruct-v0.1-Q5_K_M.gguf llama-chat.wasm -p mistral-instruct
Quantized GGUF Models
| Name | Quant method | Bits | Size | Use case |
|---|---|---|---|---|
| Mixtral-8x7B-Instruct-v0.1-Q2_K.gguf | Q2_K | 2 | 17.3 GB | smallest, significant quality loss - not recommended for most purposes |
| Mixtral-8x7B-Instruct-v0.1-Q3_K_L.gguf | Q3_K_L | 3 | 24.2 GB | small, substantial quality loss |
| Mixtral-8x7B-Instruct-v0.1-Q3_K_M.gguf | Q3_K_M | 3 | 22.5 GB | very small, high quality loss |
| Mixtral-8x7B-Instruct-v0.1-Q3_K_S.gguf | Q3_K_S | 3 | 20.4 GB | very small, high quality loss |
| Mixtral-8x7B-Instruct-v0.1-Q4_0.gguf | Q4_0 | 4 | 26.4 GB | legacy; small, very high quality loss - prefer using Q3_K_M |
| Mixtral-8x7B-Instruct-v0.1-Q4_K_M.gguf | Q4_K_M | 4 | 28.4 GB | medium, balanced quality - recommended |
| Mixtral-8x7B-Instruct-v0.1-Q4_K_S.gguf | Q4_K_S | 4 | 26.7 GB | small, greater quality loss |
| Mixtral-8x7B-Instruct-v0.1-Q5_0.gguf | Q5_0 | 5 | 32.2 GB | legacy; medium, balanced quality - prefer using Q4_K_M |
| Mixtral-8x7B-Instruct-v0.1-Q5_K_M.gguf | Q5_K_M | 5 | 33.2 GB | large, very low quality loss - recommended |
| Mixtral-8x7B-Instruct-v0.1-Q5_K_S.gguf | Q5_K_S | 5 | 32.2 GB | large, low quality loss - recommended |
| Mixtral-8x7B-Instruct-v0.1-Q6_K.gguf | Q6_K | 6 | 38.4 GB | very large, extremely low quality loss |
| Mixtral-8x7B-Instruct-v0.1-Q8_0.gguf | Q8_0 | 8 | 49.6 GB | very large, extremely low quality loss - not recommended |
Runs of second-state Mixtral-8x7B-Instruct-v0.1-GGUF on huggingface.co
393
Total runs
0
24-hour runs
-75
3-day runs
-50
7-day runs
204
30-day runs
More Information About Mixtral-8x7B-Instruct-v0.1-GGUF huggingface.co Model
Url of Mixtral-8x7B-Instruct-v0.1-GGUF
Mixtral-8x7B-Instruct-v0.1-GGUF huggingface.co Url
Provider of Mixtral-8x7B-Instruct-v0.1-GGUF huggingface.co
Other API from second-state
Updated: 2024年5月26日
Total runs:
39.7K
Run Growth:
9.3K
Growth Rate:
22.69%
Total runs:
37.9K
Run Growth:
-61.6K
Growth Rate:
-162.86%
Total runs:
11.0K
Run Growth:
3.3K
Growth Rate:
29.09%
Total runs:
10.4K
Run Growth:
6.8K
Growth Rate:
66.93%
Total runs:
8.3K
Run Growth:
6.5K
Growth Rate:
77.94%
Total runs:
7.6K
Run Growth:
-4.1K
Growth Rate:
-52.58%
Total runs:
6.3K
Run Growth:
3.3K
Growth Rate:
53.47%
Total runs:
5.5K
Run Growth:
1.8K
Growth Rate:
32.15%
Total runs:
5.3K
Run Growth:
-469
Growth Rate:
-8.73%
Total runs:
5.1K
Run Growth:
4.8K
Growth Rate:
94.95%
Total runs:
4.8K
Run Growth:
2.8K
Growth Rate:
62.24%
Total runs:
4.5K
Run Growth:
3.2K
Growth Rate:
71.13%
Total runs:
4.1K
Run Growth:
2.4K
Growth Rate:
59.06%
Total runs:
4.0K
Run Growth:
3.4K
Growth Rate:
85.04%
Total runs:
3.3K
Run Growth:
3.1K
Growth Rate:
94.93%
Total runs:
3.2K
Run Growth:
2.4K
Growth Rate:
73.58%
Total runs:
3.2K
Run Growth:
2.4K
Growth Rate:
74.71%
Total runs:
3.2K
Run Growth:
1.4K
Growth Rate:
45.56%
Total runs:
2.7K
Run Growth:
2.3K
Growth Rate:
86.04%
Total runs:
2.5K
Run Growth:
2.0K
Growth Rate:
78.96%
Total runs:
2.5K
Run Growth:
1.6K
Growth Rate:
63.43%
Total runs:
2.4K
Run Growth:
911
Growth Rate:
37.37%
Total runs:
2.1K
Run Growth:
-334
Growth Rate:
-15.77%
Total runs:
2.0K
Run Growth:
1.1K
Growth Rate:
53.82%
Total runs:
2.0K
Run Growth:
1.3K
Growth Rate:
69.71%
Total runs:
2.0K
Run Growth:
657
Growth Rate:
33.23%
Total runs:
1.8K
Run Growth:
1.4K
Growth Rate:
79.75%
Total runs:
1.8K
Run Growth:
1.6K
Growth Rate:
93.20%
Total runs:
1.7K
Run Growth:
1.5K
Growth Rate:
96.80%
Total runs:
1.7K
Run Growth:
1.1K
Growth Rate:
65.84%
Total runs:
1.7K
Run Growth:
148
Growth Rate:
8.51%
Total runs:
1.6K
Run Growth:
1.3K
Growth Rate:
90.48%
Total runs:
1.6K
Run Growth:
1.3K
Growth Rate:
90.37%
Total runs:
1.6K
Run Growth:
812
Growth Rate:
50.15%
Total runs:
1.6K
Run Growth:
1.3K
Growth Rate:
89.18%
Total runs:
1.6K
Run Growth:
1.1K
Growth Rate:
75.99%
Total runs:
1.6K
Run Growth:
790
Growth Rate:
45.98%
Total runs:
1.6K
Run Growth:
1.3K
Growth Rate:
93.02%
Total runs:
1.5K
Run Growth:
956
Growth Rate:
63.82%
Total runs:
1.5K
Run Growth:
1.3K
Growth Rate:
82.48%
Total runs:
1.5K
Run Growth:
1.3K
Growth Rate:
93.23%
Total runs:
1.5K
Run Growth:
680
Growth Rate:
46.77%
Total runs:
1.4K
Run Growth:
654
Growth Rate:
46.78%
Total runs:
1.4K
Run Growth:
1.1K
Growth Rate:
81.64%
Total runs:
1.4K
Run Growth:
596
Growth Rate:
46.20%
Total runs:
1.3K
Run Growth:
1.3K
Growth Rate:
97.92%
Total runs:
1.3K
Run Growth:
276
Growth Rate:
20.78%
Total runs:
1.2K
Run Growth:
1.0K
Growth Rate:
93.24%
Total runs:
1.2K
Run Growth:
1.1K
Growth Rate:
97.93%
Total runs:
1.2K
Run Growth:
603
Growth Rate:
64.77%
Total runs:
1.1K
Run Growth:
722
Growth Rate:
62.95%
Total runs:
1.1K
Run Growth:
810
Growth Rate:
86.17%
Total runs:
1.0K
Run Growth:
852
Growth Rate:
93.63%
Total runs:
1.0K
Run Growth:
833
Growth Rate:
91.64%
Total runs:
988
Run Growth:
-472
Growth Rate:
-46.87%
Total runs:
982
Run Growth:
-93
Growth Rate:
-9.81%
Total runs:
980
Run Growth:
762
Growth Rate:
85.04%
Total runs:
954
Run Growth:
26
Growth Rate:
2.76%
Total runs:
949
Run Growth:
-3.5K
Growth Rate:
-365.86%
Total runs:
948
Run Growth:
756
Growth Rate:
89.26%
Total runs:
944
Run Growth:
92
Growth Rate:
9.99%
Total runs:
930
Run Growth:
693
Growth Rate:
74.52%
Total runs:
909
Run Growth:
669
Growth Rate:
86.77%
Total runs:
892
Run Growth:
780
Growth Rate:
87.44%
Total runs:
853
Run Growth:
667
Growth Rate:
88.93%
Total runs:
837
Run Growth:
725
Growth Rate:
95.90%
Total runs:
753
Run Growth:
-1.5K
Growth Rate:
-200.27%
Total runs:
725
Run Growth:
-102
Growth Rate:
-14.17%
Total runs:
725
Run Growth:
226
Growth Rate:
30.62%
Total runs:
719
Run Growth:
165
Growth Rate:
22.95%
Total runs:
683
Run Growth:
575
Growth Rate:
83.82%
Total runs:
667
Run Growth:
37
Growth Rate:
5.91%
Total runs:
663
Run Growth:
455
Growth Rate:
76.60%
Total runs:
659
Run Growth:
-809
Growth Rate:
-121.29%
Total runs:
625
Run Growth:
470
Growth Rate:
75.20%
Total runs:
625
Run Growth:
555
Growth Rate:
89.81%
Total runs:
624
Run Growth:
386
Growth Rate:
68.56%
Total runs:
600
Run Growth:
578
Growth Rate:
96.01%
Total runs:
593
Run Growth:
170
Growth Rate:
30.09%
Total runs:
581
Run Growth:
52
Growth Rate:
8.84%
Total runs:
580
Run Growth:
251
Growth Rate:
46.14%
Total runs:
578
Run Growth:
71
Growth Rate:
12.28%
Total runs:
562
Run Growth:
388
Growth Rate:
69.04%
Total runs:
560
Run Growth:
467
Growth Rate:
89.29%
Total runs:
542
Run Growth:
136
Growth Rate:
25.09%
Total runs:
523
Run Growth:
393
Growth Rate:
85.81%
Total runs:
497
Run Growth:
450
Growth Rate:
90.54%
Total runs:
488
Run Growth:
235
Growth Rate:
48.45%
Total runs:
477
Run Growth:
401
Growth Rate:
84.07%
Total runs:
438
Run Growth:
313
Growth Rate:
72.29%
Total runs:
436
Run Growth:
264
Growth Rate:
60.97%
Total runs:
415
Run Growth:
-57
Growth Rate:
-13.73%
Total runs:
403
Run Growth:
310
Growth Rate:
76.73%
Total runs:
402
Run Growth:
258
Growth Rate:
64.34%
Total runs:
401
Run Growth:
153
Growth Rate:
44.74%
Total runs:
401
Run Growth:
183
Growth Rate:
46.10%
Total runs:
394
Run Growth:
138
Growth Rate:
34.85%
Total runs:
393
Run Growth:
151
Growth Rate:
52.25%
Total runs:
381
Run Growth:
133
Growth Rate:
33.25%