Total runs:
14.2K
Run Growth:
1.2K
Growth Rate:
8.60%
second-state / Phi-3-mini-4k-instruct-GGUF
Model's Last Updated: Julho 29 2024
text-generation
Introduction of Phi-3-mini-4k-instruct-GGUF
Model Details of Phi-3-mini-4k-instruct-GGUF
The gguf models have been updated! The conversion is done with llama.cpp b3463.
Phi-3-mini-4k-instruct-GGUF
Original Model
microsoft/Phi-3-mini-4k-instruct
Run with LlamaEdge
-
LlamaEdge version: v0.12.2 and above
-
Prompt template
-
Prompt type:
phi-3-chat -
Prompt string
<|system|> {system_message}<|end|> <|user|> {user_message_1}<|end|> <|assistant|> {assistant_message_1}<|end|> <|user|> {user_message_2}<|end|> <|assistant|>
-
-
Context size:
4000 -
Run as LlamaEdge service
wasmedge --dir .:. --nn-preload default:GGML:AUTO:Phi-3-mini-4k-instruct-Q5_K_M.gguf \ llama-api-server.wasm \ --prompt-template phi-3-chat \ --ctx-size 4000 \ --model-name phi-3-mini -
Run as LlamaEdge command app
wasmedge --dir .:. --nn-preload default:GGML:AUTO:Phi-3-mini-4k-instruct-Q5_K_M.gguf \ llama-chat.wasm \ --prompt-template phi-3-chat \ --ctx-size 4000
Quantized GGUF Models
| Name | Quant method | Bits | Size | Use case |
|---|---|---|---|---|
| Phi-3-mini-4k-instruct-Q2_K.gguf | Q2_K | 2 | 1.42 GB | smallest, significant quality loss - not recommended for most purposes |
| Phi-3-mini-4k-instruct-Q3_K_L.gguf | Q3_K_L | 3 | 2.09 GB | small, substantial quality loss |
| Phi-3-mini-4k-instruct-Q3_K_M.gguf | Q3_K_M | 3 | 1.96 GB | very small, high quality loss |
| Phi-3-mini-4k-instruct-Q3_K_S.gguf | Q3_K_S | 3 | 1.68 GB | very small, high quality loss |
| Phi-3-mini-4k-instruct-Q4_0.gguf | Q4_0 | 4 | 2.18 GB | legacy; small, very high quality loss - prefer using Q3_K_M |
| Phi-3-mini-4k-instruct-Q4_K_M.gguf | Q4_K_M | 4 | 2.39 GB | medium, balanced quality - recommended |
| Phi-3-mini-4k-instruct-Q4_K_S.gguf | Q4_K_S | 4 | 2.19 GB | small, greater quality loss |
| Phi-3-mini-4k-instruct-Q5_0.gguf | Q5_0 | 5 | 2.64 GB | legacy; medium, balanced quality - prefer using Q4_K_M |
| Phi-3-mini-4k-instruct-Q5_K_M.gguf | Q5_K_M | 5 | 2.82 GB | large, very low quality loss - recommended |
| Phi-3-mini-4k-instruct-Q5_K_S.gguf | Q5_K_S | 5 | 2.64 GB | large, low quality loss - recommended |
| Phi-3-mini-4k-instruct-Q6_K.gguf | Q6_K | 6 | 3.14 GB | very large, extremely low quality loss |
| Phi-3-mini-4k-instruct-Q8_0.gguf | Q8_0 | 8 | 4.06 GB | very large, extremely low quality loss - not recommended |
| Phi-3-mini-4k-instruct-f16.gguf | f16 | 16 | 7.64 GB |
Quantized with llama.cpp b3463.
Runs of second-state Phi-3-mini-4k-instruct-GGUF on huggingface.co
594
Total runs
0
24-hour runs
-6
3-day runs
56
7-day runs
-617
30-day runs
More Information About Phi-3-mini-4k-instruct-GGUF huggingface.co Model
Url of Phi-3-mini-4k-instruct-GGUF
Phi-3-mini-4k-instruct-GGUF huggingface.co Url
Provider of Phi-3-mini-4k-instruct-GGUF huggingface.co
Other API from second-state
Updated: Agosto 01 2024
Total runs:
5.2K
Run Growth:
-1.3K
Growth Rate:
-24.88%
Total runs:
2.8K
Run Growth:
991
Growth Rate:
35.98%
Total runs:
2.3K
Run Growth:
1.6K
Growth Rate:
68.84%
Total runs:
2.0K
Run Growth:
-848
Growth Rate:
-42.17%
Total runs:
1.9K
Run Growth:
-5.1K
Growth Rate:
-267.49%
Total runs:
1.5K
Run Growth:
-254
Growth Rate:
-15.96%
Total runs:
1.5K
Run Growth:
306
Growth Rate:
20.50%
Total runs:
1.3K
Run Growth:
72
Growth Rate:
5.43%
Total runs:
1.2K
Run Growth:
34
Growth Rate:
2.77%
Total runs:
1.2K
Run Growth:
574
Growth Rate:
48.15%
Total runs:
1.1K
Run Growth:
-309
Growth Rate:
-29.37%
Total runs:
1.0K
Run Growth:
-598
Growth Rate:
-58.40%
Total runs:
944
Run Growth:
-400
Growth Rate:
-42.37%
Total runs:
870
Run Growth:
22
Growth Rate:
2.53%
Total runs:
703
Run Growth:
-2.3K
Growth Rate:
-333.14%
Total runs:
688
Run Growth:
-415
Growth Rate:
-60.32%
Total runs:
638
Run Growth:
166
Growth Rate:
25.98%
Total runs:
604
Run Growth:
113
Growth Rate:
18.83%
Total runs:
571
Run Growth:
-253
Growth Rate:
-44.31%
Total runs:
567
Run Growth:
-545
Growth Rate:
-97.15%
Total runs:
539
Run Growth:
-65
Growth Rate:
-11.97%
Total runs:
528
Run Growth:
-265
Growth Rate:
-48.62%
Total runs:
504
Run Growth:
-391
Growth Rate:
-77.58%
Total runs:
450
Run Growth:
-253
Growth Rate:
-57.11%
Total runs:
435
Run Growth:
-29
Growth Rate:
-6.71%
Total runs:
367
Run Growth:
-622
Growth Rate:
-171.35%
Total runs:
361
Run Growth:
86
Growth Rate:
23.56%
Total runs:
350
Run Growth:
-95
Growth Rate:
-12.77%
Total runs:
320
Run Growth:
-152
Growth Rate:
-47.35%
Total runs:
318
Run Growth:
-178
Growth Rate:
-15.59%
Total runs:
317
Run Growth:
-387
Growth Rate:
-122.08%
Total runs:
312
Run Growth:
-268
Growth Rate:
-85.90%
Total runs:
309
Run Growth:
-567
Growth Rate:
-188.37%
Total runs:
301
Run Growth:
-806
Growth Rate:
-249.54%
Total runs:
284
Run Growth:
-268
Growth Rate:
-94.37%
Total runs:
282
Run Growth:
-194
Growth Rate:
-69.78%
Total runs:
273
Run Growth:
-398
Growth Rate:
-145.79%
Total runs:
256
Run Growth:
-124
Growth Rate:
-48.44%
Total runs:
255
Run Growth:
-360
Growth Rate:
-141.18%
Total runs:
250
Run Growth:
-385
Growth Rate:
-154.00%
Total runs:
243
Run Growth:
-383
Growth Rate:
-157.61%
Total runs:
240
Run Growth:
-230
Growth Rate:
-95.83%
Total runs:
237
Run Growth:
-469
Growth Rate:
-197.89%
Total runs:
226
Run Growth:
-1.3K
Growth Rate:
-578.02%
Total runs:
217
Run Growth:
-336
Growth Rate:
-154.84%
Total runs:
215
Run Growth:
-531
Growth Rate:
-246.98%
Total runs:
212
Run Growth:
-337
Growth Rate:
-158.96%
Total runs:
212
Run Growth:
-45
Growth Rate:
-23.32%
Total runs:
209
Run Growth:
-436
Growth Rate:
-208.61%
Total runs:
207
Run Growth:
-6
Growth Rate:
-1.46%
Total runs:
206
Run Growth:
-468
Growth Rate:
-227.18%
Total runs:
201
Run Growth:
-222
Growth Rate:
-110.45%
Total runs:
188
Run Growth:
-239
Growth Rate:
-129.19%
Total runs:
186
Run Growth:
-127
Growth Rate:
-68.28%
Total runs:
181
Run Growth:
-169
Growth Rate:
-94.41%
Total runs:
180
Run Growth:
-534
Growth Rate:
-327.61%
Total runs:
175
Run Growth:
-2.3K
Growth Rate:
-1334.29%
Total runs:
173
Run Growth:
-310
Growth Rate:
-179.19%
Total runs:
169
Run Growth:
-537
Growth Rate:
-305.11%
Total runs:
164
Run Growth:
-702
Growth Rate:
-425.45%
Total runs:
156
Run Growth:
-553
Growth Rate:
-354.49%
Total runs:
156
Run Growth:
-54
Growth Rate:
-34.62%
Total runs:
152
Run Growth:
-113
Growth Rate:
-74.34%
Total runs:
151
Run Growth:
-636
Growth Rate:
-415.69%
Total runs:
143
Run Growth:
-161
Growth Rate:
-112.59%
Total runs:
142
Run Growth:
-321
Growth Rate:
-226.06%
Total runs:
137
Run Growth:
-192
Growth Rate:
-140.15%
Total runs:
132
Run Growth:
-565
Growth Rate:
-437.98%
Total runs:
125
Run Growth:
-141
Growth Rate:
-133.02%
Total runs:
125
Run Growth:
-202
Growth Rate:
-134.67%
Total runs:
117
Run Growth:
-228
Growth Rate:
-194.87%
Total runs:
114
Run Growth:
-116
Growth Rate:
-101.75%
Total runs:
112
Run Growth:
-286
Growth Rate:
-253.10%
Total runs:
112
Run Growth:
-138
Growth Rate:
-120.00%
Total runs:
108
Run Growth:
27
Growth Rate:
5.18%
Total runs:
101
Run Growth:
-235
Growth Rate:
-232.67%
Total runs:
100
Run Growth:
-373
Growth Rate:
-330.09%
Total runs:
98
Run Growth:
-297
Growth Rate:
-303.06%
Total runs:
93
Run Growth:
-287
Growth Rate:
-308.60%
Total runs:
91
Run Growth:
-133
Growth Rate:
-146.15%
Total runs:
91
Run Growth:
8
Growth Rate:
2.43%
Total runs:
84
Run Growth:
-272
Growth Rate:
-331.71%
Total runs:
78
Run Growth:
-147
Growth Rate:
-193.42%
Total runs:
51
Run Growth:
-218
Growth Rate:
-427.45%
Total runs:
5
Run Growth:
-837
Growth Rate:
-16740.00%