Total runs:
38.8K
Run Growth:
33.7K
Growth Rate:
86.66%
second-state / Gemma-7b-it-GGUF
Model's Last Updated: March 20 2024
text-generation
Introduction of Gemma-7b-it-GGUF
Model Details of Gemma-7b-it-GGUF
Gemma-7b-it
Original Model
Run with LlamaEdge
-
LlamaEdge version: v0.3.2
-
Prompt template
-
Prompt type:
gemma-instruct -
Prompt string
<start_of_turn>user {user_message}<end_of_turn> <start_of_turn>model {model_message}<end_of_turn>model
-
-
Context size:
3072 -
Run as LlamaEdge service
wasmedge --dir .:. --nn-preload default:GGML:AUTO:gemma-7b-it-Q5_K_M.gguf llama-api-server.wasm -p gemma-instruct -c 4096 -
Run as LlamaEdge command app
wasmedge --dir .:. --nn-preload default:GGML:AUTO:gemma-7b-it-Q5_K_M.gguf llama-chat.wasm -p gemma-instruct -c 4096
Quantized GGUF Models
| Name | Quant method | Bits | Size | Use case |
|---|---|---|---|---|
| gemma-7b-it-Q2_K.gguf | Q2_K | 2 | 3.09 GB | smallest, significant quality loss - not recommended for most purposes |
| gemma-7b-it-Q3_K_L.gguf | Q3_K_L | 3 | 4.4 GB | small, substantial quality loss |
| gemma-7b-it-Q3_K_M.gguf | Q3_K_M | 3 | 4.06 GB | very small, high quality loss |
| gemma-7b-it-Q3_K_S.gguf | Q3_K_S | 3 | 3.68 GB | very small, high quality loss |
| gemma-7b-it-Q4_0.gguf | Q4_0 | 4 | 4.81 GB | legacy; small, very high quality loss - prefer using Q3_K_M |
| gemma-7b-it-Q4_K_M.gguf | Q4_K_M | 4 | 5.13 GB | medium, balanced quality - recommended |
| gemma-7b-it-Q4_K_S.gguf | Q4_K_S | 4 | 4.84 GB | small, greater quality loss |
| gemma-7b-it-Q5_0.gguf | Q5_0 | 5 | 5.88 GB | legacy; medium, balanced quality - prefer using Q4_K_M |
| gemma-7b-it-Q5_K_M.gguf | Q5_K_M | 5 | 6.04 GB | large, very low quality loss - recommended |
| gemma-7b-it-Q5_K_S.gguf | Q5_K_S | 5 | 5.88 GB | large, low quality loss - recommended |
| gemma-7b-it-Q6_K.gguf | Q6_K | 6 | 7.01 GB | very large, extremely low quality loss |
| gemma-7b-it-Q8_0.gguf | Q8_0 | 8 | 9.08 GB | very large, extremely low quality loss - not recommended |
Quantized with llama.cpp b2230
Runs of second-state Gemma-7b-it-GGUF on huggingface.co
227
Total runs
0
24-hour runs
7
3-day runs
-1
7-day runs
114
30-day runs
More Information About Gemma-7b-it-GGUF huggingface.co Model
Url of Gemma-7b-it-GGUF
Gemma-7b-it-GGUF huggingface.co Url
Provider of Gemma-7b-it-GGUF huggingface.co
Other API from second-state
Updated: March 20 2024
Total runs:
38.3K
Run Growth:
26.0K
Growth Rate:
68.20%
Total runs:
13.6K
Run Growth:
-273
Growth Rate:
-25.56%
Total runs:
10.1K
Run Growth:
6.8K
Growth Rate:
70.76%
Total runs:
8.6K
Run Growth:
8.5K
Growth Rate:
98.48%
Total runs:
6.0K
Run Growth:
-11.2K
Growth Rate:
-183.85%
Total runs:
5.2K
Run Growth:
-3.0K
Growth Rate:
-74.45%
Total runs:
4.9K
Run Growth:
3.9K
Growth Rate:
82.13%
Total runs:
4.6K
Run Growth:
7
Growth Rate:
0.97%
Total runs:
4.1K
Run Growth:
3.5K
Growth Rate:
85.02%
Total runs:
3.5K
Run Growth:
2.6K
Growth Rate:
92.56%
Total runs:
3.0K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
2.6K
Run Growth:
1.1K
Growth Rate:
92.90%
Total runs:
2.5K
Run Growth:
102
Growth Rate:
38.20%
Total runs:
2.3K
Run Growth:
916
Growth Rate:
85.45%
Total runs:
2.2K
Run Growth:
1.7K
Growth Rate:
100.00%
Total runs:
2.0K
Run Growth:
923
Growth Rate:
48.45%
Total runs:
2.0K
Run Growth:
1.1K
Growth Rate:
63.87%
Total runs:
2.0K
Run Growth:
1.3K
Growth Rate:
69.76%
Total runs:
1.9K
Run Growth:
997
Growth Rate:
100.00%
Total runs:
1.9K
Run Growth:
247
Growth Rate:
12.58%
Total runs:
1.6K
Run Growth:
1.4K
Growth Rate:
85.24%
Total runs:
1.5K
Run Growth:
845
Growth Rate:
53.28%
Total runs:
1.5K
Run Growth:
765
Growth Rate:
78.62%
Total runs:
1.5K
Run Growth:
73
Growth Rate:
25.09%
Total runs:
1.4K
Run Growth:
416
Growth Rate:
29.32%
Total runs:
1.4K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1.3K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1.3K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1.2K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1.2K
Run Growth:
606
Growth Rate:
48.10%
Total runs:
1.2K
Run Growth:
418
Growth Rate:
36.83%
Total runs:
1.1K
Run Growth:
908
Growth Rate:
81.00%
Total runs:
1.1K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
999
Run Growth:
-3.7K
Growth Rate:
-212.42%
Total runs:
994
Run Growth:
600
Growth Rate:
60.54%
Total runs:
983
Run Growth:
483
Growth Rate:
48.74%
Total runs:
882
Run Growth:
276
Growth Rate:
54.12%
Total runs:
843
Run Growth:
202
Growth Rate:
24.46%
Total runs:
784
Run Growth:
0
Growth Rate:
0.00%
Total runs:
760
Run Growth:
165
Growth Rate:
100.00%
Total runs:
734
Run Growth:
259
Growth Rate:
36.69%
Total runs:
727
Run Growth:
250
Growth Rate:
37.48%
Total runs:
652
Run Growth:
537
Growth Rate:
84.17%
Total runs:
648
Run Growth:
335
Growth Rate:
44.55%
Total runs:
631
Run Growth:
-94
Growth Rate:
-21.66%
Total runs:
609
Run Growth:
6
Growth Rate:
26.09%
Total runs:
584
Run Growth:
378
Growth Rate:
100.00%
Total runs:
559
Run Growth:
77
Growth Rate:
13.21%
Total runs:
536
Run Growth:
2.9K
Growth Rate:
100.00%
Total runs:
517
Run Growth:
0
Growth Rate:
0.00%
Total runs:
516
Run Growth:
645
Growth Rate:
95.41%
Total runs:
507
Run Growth:
146
Growth Rate:
28.24%
Total runs:
489
Run Growth:
-344
Growth Rate:
-264.62%
Total runs:
484
Run Growth:
-17
Growth Rate:
-68.00%
Total runs:
479
Run Growth:
17
Growth Rate:
20.99%
Total runs:
462
Run Growth:
0
Growth Rate:
0.00%
Total runs:
455
Run Growth:
1.3K
Growth Rate:
100.00%
Total runs:
445
Run Growth:
39
Growth Rate:
10.71%
Total runs:
445
Run Growth:
0
Growth Rate:
0.00%
Total runs:
423
Run Growth:
0
Growth Rate:
0.00%
Total runs:
417
Run Growth:
136
Growth Rate:
32.69%
Total runs:
394
Run Growth:
286
Growth Rate:
100.00%
Total runs:
371
Run Growth:
0
Growth Rate:
0.00%
Total runs:
369
Run Growth:
254
Growth Rate:
100.00%
Total runs:
353
Run Growth:
-183
Growth Rate:
-105.17%
Total runs:
349
Run Growth:
1.1K
Growth Rate:
100.00%
Total runs:
339
Run Growth:
-61
Growth Rate:
-20.13%
Total runs:
332
Run Growth:
157
Growth Rate:
61.33%
Total runs:
326
Run Growth:
-304
Growth Rate:
-147.57%
Total runs:
295
Run Growth:
93
Growth Rate:
45.37%
Total runs:
294
Run Growth:
154
Growth Rate:
52.56%
Total runs:
284
Run Growth:
31
Growth Rate:
11.40%
Total runs:
283
Run Growth:
81
Growth Rate:
28.72%
Total runs:
281
Run Growth:
549
Growth Rate:
100.00%
Total runs:
274
Run Growth:
128
Growth Rate:
48.67%
Total runs:
274
Run Growth:
45
Growth Rate:
17.18%
Total runs:
266
Run Growth:
168
Growth Rate:
65.12%
Total runs:
259
Run Growth:
0
Growth Rate:
0.00%
Total runs:
257
Run Growth:
160
Growth Rate:
58.82%
Total runs:
254
Run Growth:
155
Growth Rate:
59.85%
Total runs:
254
Run Growth:
244
Growth Rate:
100.00%
Total runs:
253
Run Growth:
0
Growth Rate:
0.00%
Total runs:
251
Run Growth:
-231
Growth Rate:
-173.68%
Total runs:
244
Run Growth:
144
Growth Rate:
60.50%
Total runs:
239
Run Growth:
149
Growth Rate:
63.14%
Total runs:
238
Run Growth:
30
Growth Rate:
12.88%
Total runs:
224
Run Growth:
128
Growth Rate:
56.14%
Total runs:
214
Run Growth:
0
Growth Rate:
0.00%
Total runs:
213
Run Growth:
171
Growth Rate:
84.65%
Total runs:
210
Run Growth:
81
Growth Rate:
36.99%
Total runs:
206
Run Growth:
-13
Growth Rate:
-6.07%
Total runs:
202
Run Growth:
112
Growth Rate:
56.00%
Total runs:
192
Run Growth:
-38
Growth Rate:
-20.54%
Total runs:
190
Run Growth:
-21
Growth Rate:
-100.00%
Total runs:
187
Run Growth:
-19
Growth Rate:
-10.16%
Total runs:
186
Run Growth:
0
Growth Rate:
0.00%
Total runs:
184
Run Growth:
0
Growth Rate:
0.00%
Total runs:
184
Run Growth:
0
Growth Rate:
0.00%