Total runs:
281.9K
Run Growth:
238.5K
Growth Rate:
86.00%
second-state / Mistral-Small-24B-Instruct-2501-GGUF
Model's Last Updated: 2025年2月6日
text-generation
Introduction of Mistral-Small-24B-Instruct-2501-GGUF
Model Details of Mistral-Small-24B-Instruct-2501-GGUF
Mistral-Small-24B-Instruct-2501-GGUF
Original Model
mistralai/Mistral-Small-24B-Instruct-2501
Run with LlamaEdge
- LlamaEdge version: coming soon
-
Prompt template
-
Prompt type:
mistral-chat -
Prompt string
<s>[SYSTEM_PROMPT]<system prompt>[/SYSTEM_PROMPT][INST]<user message>[/INST]<assistant response></s>[INST]<user message>[/INST]
-
-
Context size:
32000 -
Run as LlamaEdge service
wasmedge --dir .:. --nn-preload default:GGML:AUTO:Mistral-Small-24B-Instruct-2501-Q5_K_M.gguf \ llama-api-server.wasm \ --prompt-template mistral-chat \ --ctx-size 32000 \ --model-name Mistral-Small-24B-Instruct-2501 -
Run as LlamaEdge command app
wasmedge --dir .:. --nn-preload default:GGML:AUTO:Mistral-Small-24B-Instruct-2501-Q5_K_M.gguf \ llama-chat.wasm \ --prompt-template mistral-chat \ --ctx-size 32000
Quantized GGUF Models
| Name | Quant method | Bits | Size | Use case |
|---|---|---|---|---|
| Mistral-Small-24B-Instruct-2501-Q2_K.gguf | Q2_K | 2 | 8.89 GB | smallest, significant quality loss - not recommended for most purposes |
| Mistral-Small-24B-Instruct-2501-Q3_K_L.gguf | Q3_K_L | 3 | 12.4 GB | small, substantial quality loss |
| Mistral-Small-24B-Instruct-2501-Q3_K_M.gguf | Q3_K_M | 3 | 11.5 GB | very small, high quality loss |
| Mistral-Small-24B-Instruct-2501-Q3_K_S.gguf | Q3_K_S | 3 | 10.4 GB | very small, high quality loss |
| Mistral-Small-24B-Instruct-2501-Q4_0.gguf | Q4_0 | 4 | 13.4 GB | legacy; small, very high quality loss - prefer using Q3_K_M |
| Mistral-Small-24B-Instruct-2501-Q4_K_M.gguf | Q4_K_M | 4 | 14.3 GB | medium, balanced quality - recommended |
| Mistral-Small-24B-Instruct-2501-Q4_K_S.gguf | Q4_K_S | 4 | 13.5 GB | small, greater quality loss |
| Mistral-Small-24B-Instruct-2501-Q5_0.gguf | Q5_0 | 5 | 16.3 GB | legacy; medium, balanced quality - prefer using Q4_K_M |
| Mistral-Small-24B-Instruct-2501-Q5_K_M.gguf | Q5_K_M | 5 | 16.8 GB | large, very low quality loss - recommended |
| Mistral-Small-24B-Instruct-2501-Q5_K_S.gguf | Q5_K_S | 5 | 16.3 GB | large, low quality loss - recommended |
| Mistral-Small-24B-Instruct-2501-Q6_K.gguf | Q6_K | 6 | 19.3 GB | very large, extremely low quality loss |
| Mistral-Small-24B-Instruct-2501-Q8_0.gguf | Q8_0 | 8 | 25.1 GB | very large, extremely low quality loss - not recommended |
| Mistral-Small-24B-Instruct-2501-f16.gguf | f16 | 16 | 47.2 GB |
Quantized with llama.cpp b4595.
Runs of second-state Mistral-Small-24B-Instruct-2501-GGUF on huggingface.co
904
Total runs
0
24-hour runs
-109
3-day runs
-98
7-day runs
325
30-day runs
More Information About Mistral-Small-24B-Instruct-2501-GGUF huggingface.co Model
Url of Mistral-Small-24B-Instruct-2501-GGUF
Mistral-Small-24B-Instruct-2501-GGUF huggingface.co Url
Provider of Mistral-Small-24B-Instruct-2501-GGUF huggingface.co
Other API from second-state
Updated: 2024年3月20日
Total runs:
74.1K
Run Growth:
72.7K
Growth Rate:
98.00%
Total runs:
34.6K
Run Growth:
-2.8K
Growth Rate:
-7.84%
Total runs:
10.4K
Run Growth:
6.0K
Growth Rate:
57.40%
Total runs:
9.6K
Run Growth:
-274
Growth Rate:
-2.80%
Total runs:
6.9K
Run Growth:
-6.5K
Growth Rate:
-92.34%
Total runs:
6.7K
Run Growth:
1.7K
Growth Rate:
24.34%
Total runs:
5.0K
Run Growth:
2.7K
Growth Rate:
55.07%
Total runs:
4.9K
Run Growth:
-1.1K
Growth Rate:
-23.26%
Total runs:
4.4K
Run Growth:
2.5K
Growth Rate:
56.18%
Total runs:
4.4K
Run Growth:
2.7K
Growth Rate:
51.15%
Total runs:
3.8K
Run Growth:
1.7K
Growth Rate:
42.44%
Total runs:
3.3K
Run Growth:
2.1K
Growth Rate:
62.94%
Total runs:
3.1K
Run Growth:
1.1K
Growth Rate:
34.78%
Total runs:
3.1K
Run Growth:
1.7K
Growth Rate:
55.38%
Total runs:
3.0K
Run Growth:
867
Growth Rate:
24.74%
Total runs:
2.7K
Run Growth:
1.9K
Growth Rate:
71.27%
Total runs:
2.7K
Run Growth:
2.2K
Growth Rate:
83.87%
Total runs:
2.6K
Run Growth:
1.6K
Growth Rate:
58.76%
Total runs:
2.6K
Run Growth:
752
Growth Rate:
28.42%
Total runs:
2.4K
Run Growth:
-326
Growth Rate:
-10.35%
Total runs:
2.2K
Run Growth:
1.6K
Growth Rate:
71.50%
Total runs:
2.2K
Run Growth:
2.0K
Growth Rate:
93.26%
Total runs:
2.1K
Run Growth:
2.0K
Growth Rate:
95.31%
Total runs:
2.1K
Run Growth:
1.7K
Growth Rate:
81.53%
Total runs:
2.1K
Run Growth:
-2.2K
Growth Rate:
-90.86%
Total runs:
2.1K
Run Growth:
2.0K
Growth Rate:
96.69%
Total runs:
2.1K
Run Growth:
1.5K
Growth Rate:
77.68%
Total runs:
1.9K
Run Growth:
1.7K
Growth Rate:
90.45%
Total runs:
1.9K
Run Growth:
-877
Growth Rate:
-45.21%
Total runs:
1.9K
Run Growth:
1.7K
Growth Rate:
91.80%
Total runs:
1.9K
Run Growth:
1.7K
Growth Rate:
92.13%
Total runs:
1.9K
Run Growth:
1.6K
Growth Rate:
86.20%
Total runs:
1.9K
Run Growth:
1.0K
Growth Rate:
57.80%
Total runs:
1.8K
Run Growth:
792
Growth Rate:
39.58%
Total runs:
1.8K
Run Growth:
280
Growth Rate:
15.69%
Total runs:
1.8K
Run Growth:
1.6K
Growth Rate:
94.59%
Total runs:
1.7K
Run Growth:
991
Growth Rate:
57.45%
Total runs:
1.7K
Run Growth:
582
Growth Rate:
35.23%
Total runs:
1.7K
Run Growth:
-406
Growth Rate:
-25.14%
Total runs:
1.6K
Run Growth:
646
Growth Rate:
39.39%
Total runs:
1.6K
Run Growth:
-6.6K
Growth Rate:
-335.76%
Total runs:
1.6K
Run Growth:
615
Growth Rate:
41.08%
Total runs:
1.5K
Run Growth:
73
Growth Rate:
4.78%
Total runs:
1.5K
Run Growth:
815
Growth Rate:
52.85%
Total runs:
1.5K
Run Growth:
1.4K
Growth Rate:
90.63%
Total runs:
1.5K
Run Growth:
1.4K
Growth Rate:
95.09%
Total runs:
1.5K
Run Growth:
1.4K
Growth Rate:
93.39%
Total runs:
1.5K
Run Growth:
1.1K
Growth Rate:
77.34%
Total runs:
1.5K
Run Growth:
1.2K
Growth Rate:
88.91%
Total runs:
1.4K
Run Growth:
1.3K
Growth Rate:
92.04%
Total runs:
1.4K
Run Growth:
1.4K
Growth Rate:
98.01%
Total runs:
1.4K
Run Growth:
1.3K
Growth Rate:
93.19%
Total runs:
1.3K
Run Growth:
1.1K
Growth Rate:
90.45%
Total runs:
1.2K
Run Growth:
422
Growth Rate:
32.04%
Total runs:
1.2K
Run Growth:
-2.9K
Growth Rate:
-249.92%
Total runs:
1.2K
Run Growth:
1.1K
Growth Rate:
95.69%
Total runs:
1.2K
Run Growth:
807
Growth Rate:
69.81%
Total runs:
1.1K
Run Growth:
-24
Growth Rate:
-2.12%
Total runs:
1.0K
Run Growth:
877
Growth Rate:
88.68%
Total runs:
1.0K
Run Growth:
782
Growth Rate:
82.40%
Total runs:
1.0K
Run Growth:
20
Growth Rate:
1.99%
Total runs:
985
Run Growth:
553
Growth Rate:
47.59%
Total runs:
981
Run Growth:
-427
Growth Rate:
-43.22%
Total runs:
980
Run Growth:
337
Growth Rate:
34.07%
Total runs:
943
Run Growth:
89
Growth Rate:
9.55%
Total runs:
927
Run Growth:
598
Growth Rate:
67.04%
Total runs:
920
Run Growth:
499
Growth Rate:
58.57%
Total runs:
898
Run Growth:
735
Growth Rate:
82.49%
Total runs:
891
Run Growth:
409
Growth Rate:
50.18%
Total runs:
828
Run Growth:
711
Growth Rate:
89.89%
Total runs:
819
Run Growth:
-246
Growth Rate:
-29.15%
Total runs:
791
Run Growth:
704
Growth Rate:
91.19%
Total runs:
773
Run Growth:
-1.4K
Growth Rate:
-183.61%
Total runs:
755
Run Growth:
248
Growth Rate:
32.85%
Total runs:
727
Run Growth:
223
Growth Rate:
31.32%
Total runs:
718
Run Growth:
139
Growth Rate:
19.91%
Total runs:
689
Run Growth:
561
Growth Rate:
81.66%
Total runs:
677
Run Growth:
438
Growth Rate:
70.42%
Total runs:
660
Run Growth:
123
Growth Rate:
18.92%
Total runs:
640
Run Growth:
168
Growth Rate:
25.97%
Total runs:
634
Run Growth:
-920
Growth Rate:
-138.55%
Total runs:
603
Run Growth:
378
Growth Rate:
65.17%
Total runs:
601
Run Growth:
115
Growth Rate:
19.20%
Total runs:
596
Run Growth:
471
Growth Rate:
79.83%
Total runs:
593
Run Growth:
72
Growth Rate:
12.24%
Total runs:
592
Run Growth:
-59
Growth Rate:
-10.02%
Total runs:
566
Run Growth:
436
Growth Rate:
85.16%
Total runs:
566
Run Growth:
158
Growth Rate:
27.48%
Total runs:
547
Run Growth:
414
Growth Rate:
81.66%
Total runs:
514
Run Growth:
326
Growth Rate:
66.40%
Total runs:
496
Run Growth:
454
Growth Rate:
91.72%
Total runs:
489
Run Growth:
232
Growth Rate:
46.96%
Total runs:
481
Run Growth:
154
Growth Rate:
35.24%
Total runs:
477
Run Growth:
356
Growth Rate:
74.79%
Total runs:
463
Run Growth:
226
Growth Rate:
48.09%
Total runs:
429
Run Growth:
289
Growth Rate:
72.61%
Total runs:
422
Run Growth:
112
Growth Rate:
28.28%
Total runs:
409
Run Growth:
266
Growth Rate:
65.20%