Total runs:
99.0K
Run Growth:
96.4K
Growth Rate:
97.30%
second-state / Yi-1.5-34B-Chat-16K-GGUF
Model's Last Updated: June 13 2024
text-generation
Introduction of Yi-1.5-34B-Chat-16K-GGUF
Model Details of Yi-1.5-34B-Chat-16K-GGUF
Yi-1.5-34B-Chat-16K-GGUF
Original Model
Run with LlamaEdge
-
LlamaEdge version: v0.10.0 and above
-
Prompt template
-
Prompt type:
chatml -
Prompt string
<|im_start|>system {system_message}<|im_end|> <|im_start|>user {prompt}<|im_end|> <|im_start|>assistant -
Reverse prompt:
<|im_end|>
-
-
Context size:
16384 -
Run as LlamaEdge service
wasmedge --dir .:. --nn-preload default:GGML:AUTO:Yi-1.5-34B-Chat-16K-Q5_K_M.gguf \ llama-api-server.wasm \ --prompt-template chatml \ --reverse-prompt "<|im_end|>" \ --ctx-size 16384 \ --model-name Yi-1.5-34B-Chat-16K -
Run as LlamaEdge command app
wasmedge --dir .:. --nn-preload default:GGML:AUTO:Yi-1.5-34B-Chat-16K-Q5_K_M.gguf \ llama-chat.wasm \ --prompt-template chatml \ --reverse-prompt "<|im_end|>" \ --ctx-size 16384
Quantized GGUF Models
| Name | Quant method | Bits | Size | Use case |
|---|---|---|---|---|
| Yi-1.5-34B-Chat-16K-Q2_K.gguf | Q2_K | 2 | 12.8 GB | smallest, significant quality loss - not recommended for most purposes |
| Yi-1.5-34B-Chat-16K-Q3_K_L.gguf | Q3_K_L | 3 | 18.1 GB | small, substantial quality loss |
| Yi-1.5-34B-Chat-16K-Q3_K_M.gguf | Q3_K_M | 3 | 16.7 GB | very small, high quality loss |
| Yi-1.5-34B-Chat-16K-Q3_K_S.gguf | Q3_K_S | 3 | 15 GB | very small, high quality loss |
| Yi-1.5-34B-Chat-16K-Q4_0.gguf | Q4_0 | 4 | 19.5 GB | legacy; small, very high quality loss - prefer using Q3_K_M |
| Yi-1.5-34B-Chat-16K-Q4_K_M.gguf | Q4_K_M | 4 | 20.7 GB | medium, balanced quality - recommended |
| Yi-1.5-34B-Chat-16K-Q4_K_S.gguf | Q4_K_S | 4 | 19.6 GB | small, greater quality loss |
| Yi-1.5-34B-Chat-16K-Q5_0.gguf | Q5_0 | 5 | 23.7 GB | legacy; medium, balanced quality - prefer using Q4_K_M |
| Yi-1.5-34B-Chat-16K-Q5_K_M.gguf | Q5_K_M | 5 | 24.3 GB | large, very low quality loss - recommended |
| Yi-1.5-34B-Chat-16K-Q5_K_S.gguf | Q5_K_S | 5 | 23.7 GB | large, low quality loss - recommended |
| Yi-1.5-34B-Chat-16K-Q6_K.gguf | Q6_K | 6 | 28.2 GB | very large, extremely low quality loss |
| Yi-1.5-34B-Chat-16K-Q8_0.gguf | Q8_0 | 8 | 36.5 GB | very large, extremely low quality loss - not recommended |
| Yi-1.5-34B-Chat-16K-f16-00001-of-00003.gguf | f16 | 16 | 32.2 GB | |
| Yi-1.5-34B-Chat-16K-f16-00002-of-00003.gguf | f16 | 16 | 32.1 GB | |
| Yi-1.5-34B-Chat-16K-f16-00003-of-00003.gguf | f16 | 16 | 4.48 GB |
Quantized with llama.cpp b3135
Runs of second-state Yi-1.5-34B-Chat-16K-GGUF on huggingface.co
59
Total runs
0
24-hour runs
15
3-day runs
28
7-day runs
3
30-day runs
More Information About Yi-1.5-34B-Chat-16K-GGUF huggingface.co Model
Url of Yi-1.5-34B-Chat-16K-GGUF
Yi-1.5-34B-Chat-16K-GGUF huggingface.co Url
Provider of Yi-1.5-34B-Chat-16K-GGUF huggingface.co
Other API from second-state
Updated: March 20 2024
Total runs:
23.3K
Run Growth:
9.8K
Growth Rate:
42.23%
Total runs:
9.2K
Run Growth:
3.4K
Growth Rate:
25.57%
Total runs:
8.9K
Run Growth:
-273
Growth Rate:
-25.56%
Total runs:
7.0K
Run Growth:
3.1K
Growth Rate:
44.34%
Total runs:
5.7K
Run Growth:
-2.7K
Growth Rate:
-47.69%
Total runs:
4.2K
Run Growth:
3.7K
Growth Rate:
89.53%
Total runs:
2.6K
Run Growth:
1.5K
Growth Rate:
60.80%
Total runs:
2.4K
Run Growth:
1.5K
Growth Rate:
64.21%
Total runs:
1.9K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1.4K
Run Growth:
-691
Growth Rate:
-48.25%
Total runs:
1.4K
Run Growth:
235
Growth Rate:
16.42%
Total runs:
1.3K
Run Growth:
1.1K
Growth Rate:
83.90%
Total runs:
1.3K
Run Growth:
695
Growth Rate:
74.33%
Total runs:
1.2K
Run Growth:
1.7K
Growth Rate:
100.00%
Total runs:
1.2K
Run Growth:
621
Growth Rate:
50.74%
Total runs:
1.2K
Run Growth:
194
Growth Rate:
16.81%
Total runs:
1.1K
Run Growth:
444
Growth Rate:
39.08%
Total runs:
1.1K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1.0K
Run Growth:
997
Growth Rate:
100.00%
Total runs:
970
Run Growth:
146
Growth Rate:
14.79%
Total runs:
969
Run Growth:
519
Growth Rate:
53.56%
Total runs:
876
Run Growth:
-1.6K
Growth Rate:
-181.51%
Total runs:
870
Run Growth:
195
Growth Rate:
22.41%
Total runs:
851
Run Growth:
7
Growth Rate:
0.97%
Total runs:
769
Run Growth:
304
Growth Rate:
39.53%
Total runs:
723
Run Growth:
165
Growth Rate:
100.00%
Total runs:
715
Run Growth:
370
Growth Rate:
64.46%
Total runs:
701
Run Growth:
-3.7K
Growth Rate:
-212.42%
Total runs:
636
Run Growth:
278
Growth Rate:
65.11%
Total runs:
597
Run Growth:
645
Growth Rate:
95.41%
Total runs:
555
Run Growth:
0
Growth Rate:
0.00%
Total runs:
540
Run Growth:
-94
Growth Rate:
-21.66%
Total runs:
535
Run Growth:
69
Growth Rate:
12.90%
Total runs:
534
Run Growth:
378
Growth Rate:
100.00%
Total runs:
527
Run Growth:
0
Growth Rate:
0.00%
Total runs:
511
Run Growth:
276
Growth Rate:
54.12%
Total runs:
506
Run Growth:
-192
Growth Rate:
-37.94%
Total runs:
501
Run Growth:
0
Growth Rate:
0.00%
Total runs:
499
Run Growth:
11
Growth Rate:
2.20%
Total runs:
495
Run Growth:
-50
Growth Rate:
-10.10%
Total runs:
495
Run Growth:
255
Growth Rate:
51.83%
Total runs:
483
Run Growth:
317
Growth Rate:
65.63%
Total runs:
482
Run Growth:
64
Growth Rate:
13.28%
Total runs:
457
Run Growth:
-43
Growth Rate:
-9.41%
Total runs:
429
Run Growth:
2.9K
Growth Rate:
100.00%
Total runs:
415
Run Growth:
286
Growth Rate:
100.00%
Total runs:
403
Run Growth:
0
Growth Rate:
0.00%
Total runs:
402
Run Growth:
114
Growth Rate:
28.36%
Total runs:
370
Run Growth:
0
Growth Rate:
0.00%
Total runs:
364
Run Growth:
-344
Growth Rate:
-264.62%
Total runs:
362
Run Growth:
0
Growth Rate:
0.00%
Total runs:
350
Run Growth:
254
Growth Rate:
100.00%
Total runs:
340
Run Growth:
1.3K
Growth Rate:
100.00%
Total runs:
339
Run Growth:
111
Growth Rate:
32.74%
Total runs:
321
Run Growth:
244
Growth Rate:
100.00%
Total runs:
299
Run Growth:
0
Growth Rate:
0.00%
Total runs:
292
Run Growth:
195
Growth Rate:
66.78%
Total runs:
274
Run Growth:
-15
Growth Rate:
-5.47%
Total runs:
270
Run Growth:
-183
Growth Rate:
-105.17%
Total runs:
269
Run Growth:
0
Growth Rate:
0.00%
Total runs:
257
Run Growth:
549
Growth Rate:
100.00%
Total runs:
256
Run Growth:
-73
Growth Rate:
-28.52%
Total runs:
241
Run Growth:
-122
Growth Rate:
-50.62%
Total runs:
240
Run Growth:
0
Growth Rate:
0.00%
Total runs:
237
Run Growth:
-32
Growth Rate:
-13.50%
Total runs:
233
Run Growth:
0
Growth Rate:
0.00%
Total runs:
233
Run Growth:
108
Growth Rate:
46.35%
Total runs:
230
Run Growth:
-127
Growth Rate:
-54.04%
Total runs:
227
Run Growth:
5
Growth Rate:
2.20%
Total runs:
223
Run Growth:
92
Growth Rate:
41.26%
Total runs:
215
Run Growth:
39
Growth Rate:
18.14%
Total runs:
212
Run Growth:
-73
Growth Rate:
-34.43%
Total runs:
207
Run Growth:
-32
Growth Rate:
-15.46%
Total runs:
206
Run Growth:
33
Growth Rate:
16.42%
Total runs:
204
Run Growth:
50
Growth Rate:
24.51%
Total runs:
201
Run Growth:
1.1K
Growth Rate:
100.00%
Total runs:
199
Run Growth:
-16
Growth Rate:
-8.04%
Total runs:
198
Run Growth:
275
Growth Rate:
100.00%
Total runs:
197
Run Growth:
-30
Growth Rate:
-15.71%
Total runs:
197
Run Growth:
-84
Growth Rate:
-42.64%
Total runs:
197
Run Growth:
49
Growth Rate:
24.87%
Total runs:
191
Run Growth:
43
Growth Rate:
22.51%
Total runs:
190
Run Growth:
8
Growth Rate:
4.21%
Total runs:
190
Run Growth:
-67
Growth Rate:
-35.26%
Total runs:
188
Run Growth:
0
Growth Rate:
0.00%
Total runs:
184
Run Growth:
-676
Growth Rate:
-171.14%
Total runs:
181
Run Growth:
23
Growth Rate:
12.71%
Total runs:
181
Run Growth:
-210
Growth Rate:
-116.02%
Total runs:
180
Run Growth:
-21
Growth Rate:
-11.67%
Total runs:
178
Run Growth:
87
Growth Rate:
22.08%
Total runs:
177
Run Growth:
70
Growth Rate:
39.55%
Total runs:
175
Run Growth:
-408
Growth Rate:
-233.14%
Total runs:
174
Run Growth:
-30
Growth Rate:
-17.24%
Total runs:
173
Run Growth:
-147
Growth Rate:
-84.97%
Total runs:
169
Run Growth:
17
Growth Rate:
4.11%
Total runs:
168
Run Growth:
141
Growth Rate:
27.43%
Total runs:
167
Run Growth:
-375
Growth Rate:
-203.80%
Total runs:
163
Run Growth:
-8
Growth Rate:
-4.91%