Total runs:
287.2K
Run Growth:
248.4K
Growth Rate:
86.50%
second-state / Qwen2.5-7B-Instruct-1M-GGUF
Model's Last Updated: 2025年1月27日
text-generation
Introduction of Qwen2.5-7B-Instruct-1M-GGUF
Model Details of Qwen2.5-7B-Instruct-1M-GGUF
Qwen2.5-7B-Instruct-1M-GGUF
Original Model
Run with LlamaEdge
-
LlamaEdge version: v0.16.2
-
Prompt template
-
Prompt type:
chatml -
Prompt string
<|im_start|>system {system_message}<|im_end|> <|im_start|>user {prompt}<|im_end|> <|im_start|>assistant
-
-
Context size:
1010000(generation 8192 tokens) -
Run as LlamaEdge service
wasmedge --dir .:. --nn-preload default:GGML:AUTO:Qwen2.5-7B-Instruct-1M-Q5_K_M.gguf \ llama-api-server.wasm \ --model-name Qwen2.5-7B-Instruct-1M \ --prompt-template chatml \ --ctx-size 1010000 -
Run as LlamaEdge command app
wasmedge --dir .:. --nn-preload default:GGML:AUTO:Qwen2.5-7B-Instruct-1M-Q5_K_M.gguf \ llama-chat.wasm \ --prompt-template chatml \ --ctx-size 1010000
Quantized GGUF Models
| Name | Quant method | Bits | Size | Use case |
|---|---|---|---|---|
| Qwen2.5-7B-Instruct-1M-Q2_K.gguf | Q2_K | 2 | 3.02 GB | smallest, significant quality loss - not recommended for most purposes |
| Qwen2.5-7B-Instruct-1M-Q3_K_L.gguf | Q3_K_L | 3 | 4.09 GB | small, substantial quality loss |
| Qwen2.5-7B-Instruct-1M-Q3_K_M.gguf | Q3_K_M | 3 | 3.81 GB | very small, high quality loss |
| Qwen2.5-7B-Instruct-1M-Q3_K_S.gguf | Q3_K_S | 3 | 3.49 GB | very small, high quality loss |
| Qwen2.5-7B-Instruct-1M-Q4_0.gguf | Q4_0 | 4 | 4.43 GB | legacy; small, very high quality loss - prefer using Q3_K_M |
| Qwen2.5-7B-Instruct-1M-Q4_K_M.gguf | Q4_K_M | 4 | 4.68 GB | medium, balanced quality - recommended |
| Qwen2.5-7B-Instruct-1M-Q4_K_S.gguf | Q4_K_S | 4 | 4.46 GB | small, greater quality loss |
| Qwen2.5-7B-Instruct-1M-Q5_0.gguf | Q5_0 | 5 | 5.32 GB | legacy; medium, balanced quality - prefer using Q4_K_M |
| Qwen2.5-7B-Instruct-1M-Q5_K_M.gguf | Q5_K_M | 5 | 5.44 GB | large, very low quality loss - recommended |
| Qwen2.5-7B-Instruct-1M-Q5_K_S.gguf | Q5_K_S | 5 | 5.32 GB | large, low quality loss - recommended |
| Qwen2.5-7B-Instruct-1M-Q6_K.gguf | Q6_K | 6 | 6.25 GB | very large, extremely low quality loss |
| Qwen2.5-7B-Instruct-1M-Q8_0.gguf | Q8_0 | 8 | 8.21 GB | very large, extremely low quality loss - not recommended |
| Qwen2.5-7B-Instruct-1M-f16.gguf | f16 | 16 | 15.2 GB |
Quantized with llama.cpp b4466
Runs of second-state Qwen2.5-7B-Instruct-1M-GGUF on huggingface.co
154
Total runs
0
24-hour runs
29
3-day runs
12
7-day runs
-70
30-day runs
More Information About Qwen2.5-7B-Instruct-1M-GGUF huggingface.co Model
Url of Qwen2.5-7B-Instruct-1M-GGUF
Qwen2.5-7B-Instruct-1M-GGUF huggingface.co Url
Provider of Qwen2.5-7B-Instruct-1M-GGUF huggingface.co
Other API from second-state
Updated: 2024年3月20日
Total runs:
73.9K
Run Growth:
63.3K
Growth Rate:
85.74%
Total runs:
34.2K
Run Growth:
-4.9K
Growth Rate:
-14.22%
Total runs:
14.4K
Run Growth:
2.5K
Growth Rate:
30.10%
Total runs:
10.7K
Run Growth:
5.6K
Growth Rate:
52.47%
Total runs:
9.3K
Run Growth:
-1.0K
Growth Rate:
-10.87%
Total runs:
6.7K
Run Growth:
-7.2K
Growth Rate:
-108.36%
Total runs:
5.2K
Run Growth:
91
Growth Rate:
1.71%
Total runs:
5.1K
Run Growth:
2.8K
Growth Rate:
55.02%
Total runs:
4.5K
Run Growth:
2.5K
Growth Rate:
55.67%
Total runs:
3.3K
Run Growth:
2.1K
Growth Rate:
62.01%
Total runs:
3.1K
Run Growth:
1.7K
Growth Rate:
55.56%
Total runs:
2.9K
Run Growth:
419
Growth Rate:
14.21%
Total runs:
2.9K
Run Growth:
882
Growth Rate:
30.17%
Total runs:
2.8K
Run Growth:
2.0K
Growth Rate:
70.87%
Total runs:
2.8K
Run Growth:
371
Growth Rate:
13.30%
Total runs:
2.8K
Run Growth:
776
Growth Rate:
28.48%
Total runs:
2.7K
Run Growth:
1.4K
Growth Rate:
51.91%
Total runs:
2.7K
Run Growth:
2.2K
Growth Rate:
83.04%
Total runs:
2.5K
Run Growth:
-1.0K
Growth Rate:
-41.44%
Total runs:
2.3K
Run Growth:
1.7K
Growth Rate:
72.74%
Total runs:
2.3K
Run Growth:
1.9K
Growth Rate:
82.87%
Total runs:
2.3K
Run Growth:
2.1K
Growth Rate:
92.94%
Total runs:
2.2K
Run Growth:
2.1K
Growth Rate:
96.86%
Total runs:
2.2K
Run Growth:
2.1K
Growth Rate:
95.47%
Total runs:
2.2K
Run Growth:
1.7K
Growth Rate:
79.04%
Total runs:
2.0K
Run Growth:
-2.6K
Growth Rate:
-132.17%
Total runs:
2.0K
Run Growth:
1.8K
Growth Rate:
92.10%
Total runs:
2.0K
Run Growth:
1.8K
Growth Rate:
90.80%
Total runs:
2.0K
Run Growth:
1.9K
Growth Rate:
95.72%
Total runs:
2.0K
Run Growth:
1.7K
Growth Rate:
86.43%
Total runs:
1.9K
Run Growth:
-1.1K
Growth Rate:
-56.73%
Total runs:
1.9K
Run Growth:
1.1K
Growth Rate:
60.15%
Total runs:
1.9K
Run Growth:
1.8K
Growth Rate:
94.89%
Total runs:
1.8K
Run Growth:
298
Growth Rate:
16.45%
Total runs:
1.8K
Run Growth:
591
Growth Rate:
32.89%
Total runs:
1.8K
Run Growth:
1.0K
Growth Rate:
57.48%
Total runs:
1.7K
Run Growth:
616
Growth Rate:
36.04%
Total runs:
1.7K
Run Growth:
664
Growth Rate:
39.50%
Total runs:
1.6K
Run Growth:
-7.1K
Growth Rate:
-438.08%
Total runs:
1.6K
Run Growth:
737
Growth Rate:
46.15%
Total runs:
1.6K
Run Growth:
1.4K
Growth Rate:
91.06%
Total runs:
1.6K
Run Growth:
1.5K
Growth Rate:
94.12%
Total runs:
1.5K
Run Growth:
805
Growth Rate:
52.00%
Total runs:
1.5K
Run Growth:
1.4K
Growth Rate:
90.94%
Total runs:
1.5K
Run Growth:
1.4K
Growth Rate:
92.73%
Total runs:
1.5K
Run Growth:
1.4K
Growth Rate:
93.67%
Total runs:
1.5K
Run Growth:
1.2K
Growth Rate:
77.49%
Total runs:
1.5K
Run Growth:
1.4K
Growth Rate:
93.10%
Total runs:
1.4K
Run Growth:
1.4K
Growth Rate:
98.06%
Total runs:
1.4K
Run Growth:
-701
Growth Rate:
-51.73%
Total runs:
1.3K
Run Growth:
1.2K
Growth Rate:
90.91%
Total runs:
1.3K
Run Growth:
330
Growth Rate:
25.00%
Total runs:
1.3K
Run Growth:
-1.4K
Growth Rate:
-111.40%
Total runs:
1.2K
Run Growth:
1.2K
Growth Rate:
95.94%
Total runs:
1.2K
Run Growth:
-2.9K
Growth Rate:
-251.97%
Total runs:
1.2K
Run Growth:
825
Growth Rate:
70.57%
Total runs:
1.1K
Run Growth:
918
Growth Rate:
84.61%
Total runs:
1.1K
Run Growth:
-75
Growth Rate:
-6.95%
Total runs:
1.1K
Run Growth:
942
Growth Rate:
89.37%
Total runs:
1.0K
Run Growth:
50
Growth Rate:
4.99%
Total runs:
985
Run Growth:
579
Growth Rate:
58.78%
Total runs:
978
Run Growth:
-441
Growth Rate:
-45.09%
Total runs:
978
Run Growth:
310
Growth Rate:
31.70%
Total runs:
944
Run Growth:
587
Growth Rate:
62.18%
Total runs:
929
Run Growth:
772
Growth Rate:
83.10%
Total runs:
922
Run Growth:
65
Growth Rate:
7.05%
Total runs:
875
Run Growth:
329
Growth Rate:
37.60%
Total runs:
831
Run Growth:
752
Growth Rate:
90.49%
Total runs:
831
Run Growth:
536
Growth Rate:
64.50%
Total runs:
809
Run Growth:
723
Growth Rate:
89.37%
Total runs:
797
Run Growth:
-365
Growth Rate:
-45.80%
Total runs:
750
Run Growth:
259
Growth Rate:
34.53%
Total runs:
745
Run Growth:
208
Growth Rate:
27.92%
Total runs:
724
Run Growth:
433
Growth Rate:
59.81%
Total runs:
708
Run Growth:
144
Growth Rate:
20.34%
Total runs:
702
Run Growth:
110
Growth Rate:
15.67%
Total runs:
684
Run Growth:
558
Growth Rate:
81.58%
Total runs:
680
Run Growth:
-851
Growth Rate:
-125.15%
Total runs:
657
Run Growth:
462
Growth Rate:
70.32%
Total runs:
638
Run Growth:
-1.4K
Growth Rate:
-217.24%
Total runs:
625
Run Growth:
-1.0K
Growth Rate:
-164.32%
Total runs:
612
Run Growth:
111
Growth Rate:
18.14%
Total runs:
600
Run Growth:
51
Growth Rate:
8.50%
Total runs:
598
Run Growth:
522
Growth Rate:
87.29%
Total runs:
589
Run Growth:
467
Growth Rate:
79.29%
Total runs:
581
Run Growth:
-34
Growth Rate:
-5.85%
Total runs:
568
Run Growth:
474
Growth Rate:
83.45%
Total runs:
562
Run Growth:
118
Growth Rate:
21.00%
Total runs:
542
Run Growth:
261
Growth Rate:
46.03%
Total runs:
530
Run Growth:
-123
Growth Rate:
-23.21%
Total runs:
508
Run Growth:
346
Growth Rate:
68.11%
Total runs:
500
Run Growth:
0
Growth Rate:
0.00%
Total runs:
495
Run Growth:
456
Growth Rate:
92.12%
Total runs:
491
Run Growth:
371
Growth Rate:
75.56%
Total runs:
482
Run Growth:
182
Growth Rate:
37.76%
Total runs:
465
Run Growth:
224
Growth Rate:
48.38%
Total runs:
429
Run Growth:
275
Growth Rate:
64.10%
Total runs:
425
Run Growth:
243
Growth Rate:
57.18%