Total runs:
99.3K
Run Growth:
96.4K
Growth Rate:
97.30%
second-state / Phi-3-medium-4k-instruct-GGUF
Model's Last Updated: May 26 2024
text-generation
Introduction of Phi-3-medium-4k-instruct-GGUF
Model Details of Phi-3-medium-4k-instruct-GGUF
Phi-3-medium-4k-instruct-GGUF
Original Model
microsoft/Phi-3-medium-4k-instruct
Run with LlamaEdge
-
LlamaEdge version: v0.11.2 and above
-
Prompt template
-
Prompt type:
phi-3-chat -
Prompt string
<|system|> {system_message}<|end|> <|user|> {user_message_1}<|end|> <|assistant|> {assistant_message_1}<|end|> <|user|> {user_message_2}<|end|> <|assistant|>
-
-
Context size:
4000 -
Run as LlamaEdge service
wasmedge --dir .:. --nn-preload default:GGML:AUTO:Phi-3-medium-4k-instruct-Q5_K_M.gguf \ llama-api-server.wasm \ --prompt-template phi-3-chat \ --ctx-size 4000 \ --model-name phi-3-medium-4k -
Run as LlamaEdge command app
wasmedge --dir .:. --nn-preload default:GGML:AUTO:Phi-3-medium-4k-instruct-Q5_K_M.gguf \ llama-chat.wasm \ --prompt-template phi-3-chat \ --ctx-size 4000
Quantized GGUF Models
| Name | Quant method | Bits | Size | Use case |
|---|---|---|---|---|
| Phi-3-medium-4k-instruct-Q2_K.gguf | Q2_K | 2 | 5.14 GB | smallest, significant quality loss - not recommended for most purposes |
| Phi-3-medium-4k-instruct-Q3_K_L.gguf | Q3_K_L | 3 | 7.49 GB | small, substantial quality loss |
| Phi-3-medium-4k-instruct-Q3_K_M.gguf | Q3_K_M | 3 | 6.92 GB | very small, high quality loss |
| Phi-3-medium-4k-instruct-Q3_K_S.gguf | Q3_K_S | 3 | 6.06 GB | very small, high quality loss |
| Phi-3-medium-4k-instruct-Q4_0.gguf | Q4_0 | 4 | 7.9 GB | legacy; small, very high quality loss - prefer using Q3_K_M |
| Phi-3-medium-4k-instruct-Q4_K_M.gguf | Q4_K_M | 4 | 8.57 GB | medium, balanced quality - recommended |
| Phi-3-medium-4k-instruct-Q4_K_S.gguf | Q4_K_S | 4 | 7.95 GB | small, greater quality loss |
| Phi-3-medium-4k-instruct-Q5_0.gguf | Q5_0 | 5 | 9.62 GB | legacy; medium, balanced quality - prefer using Q4_K_M |
| Phi-3-medium-4k-instruct-Q5_K_M.gguf | Q5_K_M | 5 | 10.1 GB | large, very low quality loss - recommended |
| Phi-3-medium-4k-instruct-Q5_K_S.gguf | Q5_K_S | 5 | 9.62 GB | large, low quality loss - recommended |
| Phi-3-medium-4k-instruct-Q6_K.gguf | Q6_K | 6 | 11.5 GB | very large, extremely low quality loss |
| Phi-3-medium-4k-instruct-Q8_0.gguf | Q8_0 | 8 | 14.8 GB | very large, extremely low quality loss - not recommended |
| Phi-3-medium-4k-instruct-f16.gguf | f16 | 16 | 27.9 GB |
Quantized with llama.cpp b2961.
Runs of second-state Phi-3-medium-4k-instruct-GGUF on huggingface.co
81
Total runs
0
24-hour runs
-1
3-day runs
8
7-day runs
13
30-day runs
More Information About Phi-3-medium-4k-instruct-GGUF huggingface.co Model
Url of Phi-3-medium-4k-instruct-GGUF
Phi-3-medium-4k-instruct-GGUF huggingface.co Url
Provider of Phi-3-medium-4k-instruct-GGUF huggingface.co
Other API from second-state
Updated: March 20 2024
Total runs:
24.6K
Run Growth:
9.8K
Growth Rate:
42.23%
Total runs:
9.2K
Run Growth:
3.4K
Growth Rate:
25.57%
Total runs:
8.9K
Run Growth:
-273
Growth Rate:
-25.56%
Total runs:
7.0K
Run Growth:
3.1K
Growth Rate:
44.34%
Total runs:
5.7K
Run Growth:
-2.7K
Growth Rate:
-47.69%
Total runs:
4.2K
Run Growth:
3.7K
Growth Rate:
89.53%
Total runs:
2.6K
Run Growth:
1.5K
Growth Rate:
60.80%
Total runs:
2.4K
Run Growth:
1.5K
Growth Rate:
64.21%
Total runs:
1.9K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1.4K
Run Growth:
-691
Growth Rate:
-48.25%
Total runs:
1.4K
Run Growth:
235
Growth Rate:
16.42%
Total runs:
1.3K
Run Growth:
1.1K
Growth Rate:
83.90%
Total runs:
1.3K
Run Growth:
444
Growth Rate:
39.08%
Total runs:
1.3K
Run Growth:
695
Growth Rate:
74.33%
Total runs:
1.3K
Run Growth:
621
Growth Rate:
50.74%
Total runs:
1.2K
Run Growth:
1.7K
Growth Rate:
100.00%
Total runs:
1.2K
Run Growth:
194
Growth Rate:
16.81%
Total runs:
1.1K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1.0K
Run Growth:
997
Growth Rate:
100.00%
Total runs:
970
Run Growth:
146
Growth Rate:
14.79%
Total runs:
969
Run Growth:
519
Growth Rate:
53.56%
Total runs:
870
Run Growth:
195
Growth Rate:
22.41%
Total runs:
857
Run Growth:
-1.6K
Growth Rate:
-181.51%
Total runs:
851
Run Growth:
7
Growth Rate:
0.97%
Total runs:
769
Run Growth:
304
Growth Rate:
39.53%
Total runs:
723
Run Growth:
165
Growth Rate:
100.00%
Total runs:
715
Run Growth:
370
Growth Rate:
64.46%
Total runs:
701
Run Growth:
-3.7K
Growth Rate:
-212.42%
Total runs:
636
Run Growth:
278
Growth Rate:
65.11%
Total runs:
597
Run Growth:
645
Growth Rate:
95.41%
Total runs:
580
Run Growth:
317
Growth Rate:
65.63%
Total runs:
555
Run Growth:
0
Growth Rate:
0.00%
Total runs:
540
Run Growth:
-94
Growth Rate:
-21.66%
Total runs:
535
Run Growth:
69
Growth Rate:
12.90%
Total runs:
534
Run Growth:
378
Growth Rate:
100.00%
Total runs:
527
Run Growth:
0
Growth Rate:
0.00%
Total runs:
511
Run Growth:
276
Growth Rate:
54.12%
Total runs:
506
Run Growth:
-192
Growth Rate:
-37.94%
Total runs:
501
Run Growth:
0
Growth Rate:
0.00%
Total runs:
499
Run Growth:
11
Growth Rate:
2.20%
Total runs:
495
Run Growth:
-50
Growth Rate:
-10.10%
Total runs:
495
Run Growth:
255
Growth Rate:
51.83%
Total runs:
482
Run Growth:
64
Growth Rate:
13.28%
Total runs:
457
Run Growth:
-43
Growth Rate:
-9.41%
Total runs:
429
Run Growth:
2.9K
Growth Rate:
100.00%
Total runs:
403
Run Growth:
0
Growth Rate:
0.00%
Total runs:
403
Run Growth:
286
Growth Rate:
100.00%
Total runs:
402
Run Growth:
114
Growth Rate:
28.36%
Total runs:
378
Run Growth:
0
Growth Rate:
0.00%
Total runs:
364
Run Growth:
-344
Growth Rate:
-264.62%
Total runs:
362
Run Growth:
0
Growth Rate:
0.00%
Total runs:
350
Run Growth:
254
Growth Rate:
100.00%
Total runs:
340
Run Growth:
1.3K
Growth Rate:
100.00%
Total runs:
339
Run Growth:
111
Growth Rate:
32.74%
Total runs:
321
Run Growth:
244
Growth Rate:
100.00%
Total runs:
299
Run Growth:
0
Growth Rate:
0.00%
Total runs:
292
Run Growth:
195
Growth Rate:
66.78%
Total runs:
274
Run Growth:
0
Growth Rate:
0.00%
Total runs:
270
Run Growth:
-183
Growth Rate:
-105.17%
Total runs:
270
Run Growth:
-15
Growth Rate:
-5.47%
Total runs:
257
Run Growth:
549
Growth Rate:
100.00%
Total runs:
256
Run Growth:
-73
Growth Rate:
-28.52%
Total runs:
248
Run Growth:
43
Growth Rate:
22.51%
Total runs:
241
Run Growth:
-122
Growth Rate:
-50.62%
Total runs:
240
Run Growth:
0
Growth Rate:
0.00%
Total runs:
237
Run Growth:
-32
Growth Rate:
-13.50%
Total runs:
233
Run Growth:
0
Growth Rate:
0.00%
Total runs:
233
Run Growth:
108
Growth Rate:
46.35%
Total runs:
230
Run Growth:
-127
Growth Rate:
-54.04%
Total runs:
227
Run Growth:
5
Growth Rate:
2.20%
Total runs:
223
Run Growth:
92
Growth Rate:
41.26%
Total runs:
213
Run Growth:
39
Growth Rate:
18.14%
Total runs:
212
Run Growth:
-73
Growth Rate:
-34.43%
Total runs:
207
Run Growth:
-32
Growth Rate:
-15.46%
Total runs:
204
Run Growth:
50
Growth Rate:
24.51%
Total runs:
201
Run Growth:
1.1K
Growth Rate:
100.00%
Total runs:
201
Run Growth:
33
Growth Rate:
16.42%
Total runs:
199
Run Growth:
-16
Growth Rate:
-8.04%
Total runs:
198
Run Growth:
275
Growth Rate:
100.00%
Total runs:
197
Run Growth:
-30
Growth Rate:
-15.71%
Total runs:
197
Run Growth:
-84
Growth Rate:
-42.64%
Total runs:
197
Run Growth:
49
Growth Rate:
24.87%
Total runs:
190
Run Growth:
8
Growth Rate:
4.21%
Total runs:
190
Run Growth:
-67
Growth Rate:
-35.26%
Total runs:
188
Run Growth:
0
Growth Rate:
0.00%
Total runs:
185
Run Growth:
-210
Growth Rate:
-116.02%
Total runs:
184
Run Growth:
-676
Growth Rate:
-171.14%
Total runs:
181
Run Growth:
23
Growth Rate:
12.71%
Total runs:
180
Run Growth:
-21
Growth Rate:
-11.67%
Total runs:
178
Run Growth:
87
Growth Rate:
22.08%
Total runs:
177
Run Growth:
70
Growth Rate:
39.55%
Total runs:
175
Run Growth:
-408
Growth Rate:
-233.14%
Total runs:
174
Run Growth:
-30
Growth Rate:
-17.24%
Total runs:
173
Run Growth:
-147
Growth Rate:
-84.97%
Total runs:
169
Run Growth:
17
Growth Rate:
4.11%
Total runs:
168
Run Growth:
141
Growth Rate:
27.43%
Total runs:
167
Run Growth:
-375
Growth Rate:
-203.80%
Total runs:
163
Run Growth:
-8
Growth Rate:
-4.91%