Total runs:
627.8K
Run Growth:
583.1K
Growth Rate:
93.94%
mradermacher / gemma-2-9b-it-SimPO-i1-GGUF
Model's Last Updated: August 02 2024
Introduction of gemma-2-9b-it-SimPO-i1-GGUF
Model Details of gemma-2-9b-it-SimPO-i1-GGUF
About
weighted/imatrix quants of https://huggingface.co/princeton-nlp/gemma-2-9b-it-SimPO
static quants are available at https://huggingface.co/mradermacher/gemma-2-9b-it-SimPO-GGUF
Usage
If you are unsure how to use GGUF files, refer to one of TheBloke's READMEs for more details, including on how to concatenate multi-part files.
Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|---|---|---|---|
| GGUF | i1-IQ1_S | 2.5 | for the desperate |
| GGUF | i1-IQ1_M | 2.6 | mostly desperate |
| GGUF | i1-IQ2_XXS | 2.9 | |
| GGUF | i1-IQ2_XS | 3.2 | |
| GGUF | i1-IQ2_S | 3.3 | |
| GGUF | i1-IQ2_M | 3.5 | |
| GGUF | i1-IQ3_XXS | 3.9 | lower quality |
| GGUF | i1-Q2_K | 3.9 | IQ3_XXS probably better |
| GGUF | i1-IQ3_XS | 4.2 | |
| GGUF | i1-IQ3_S | 4.4 | beats Q3_K* |
| GGUF | i1-Q3_K_S | 4.4 | IQ3_XS probably better |
| GGUF | i1-IQ3_M | 4.6 | |
| GGUF | i1-Q3_K_M | 4.9 | IQ3_S probably better |
| GGUF | i1-Q3_K_L | 5.2 | IQ3_M probably better |
| GGUF | i1-IQ4_XS | 5.3 | |
| GGUF | i1-Q4_0 | 5.6 | fast, low quality |
| GGUF | i1-Q4_K_S | 5.6 | optimal size/speed/quality |
| GGUF | i1-Q4_K_M | 5.9 | fast, recommended |
| GGUF | i1-Q5_K_S | 6.6 | |
| GGUF | i1-Q5_K_M | 6.7 | |
| GGUF | i1-Q6_K | 7.7 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant types (lower is better):
And here are Artefact2's thoughts on the matter: https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to questions you might have and/or if you want some other model quantized.
Thanks
I thank my company, nethype GmbH , for letting me use its servers and providing upgrades to my workstation to enable this work in my free time. Additional thanks to @nicoboss for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
Runs of mradermacher gemma-2-9b-it-SimPO-i1-GGUF on huggingface.co
3.4K
Total runs
0
24-hour runs
185
3-day runs
-311
7-day runs
2.3K
30-day runs
More Information About gemma-2-9b-it-SimPO-i1-GGUF huggingface.co Model
Url of gemma-2-9b-it-SimPO-i1-GGUF
gemma-2-9b-it-SimPO-i1-GGUF huggingface.co Url
Provider of gemma-2-9b-it-SimPO-i1-GGUF huggingface.co
Other API from mradermacher
Updated: January 21 2025
Total runs:
307.6K
Run Growth:
221.7K
Growth Rate:
66.40%
Total runs:
167.8K
Run Growth:
140.6K
Growth Rate:
75.37%
Total runs:
87.1K
Run Growth:
40.3K
Growth Rate:
45.07%
Total runs:
83.5K
Run Growth:
81.8K
Growth Rate:
88.25%
Total runs:
74.0K
Run Growth:
64.5K
Growth Rate:
86.81%
Total runs:
65.5K
Run Growth:
54.2K
Growth Rate:
82.15%
Total runs:
64.7K
Run Growth:
64.7K
Growth Rate:
100.00%
Total runs:
55.7K
Run Growth:
34.2K
Growth Rate:
98.10%
Total runs:
52.6K
Run Growth:
38.9K
Growth Rate:
75.27%
Total runs:
49.8K
Run Growth:
14.4K
Growth Rate:
26.25%
Total runs:
48.2K
Run Growth:
47.9K
Growth Rate:
99.53%
Total runs:
47.8K
Run Growth:
-13.4K
Growth Rate:
-27.94%
Total runs:
42.0K
Run Growth:
10.6K
Growth Rate:
24.05%
Total runs:
35.6K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
31.2K
Run Growth:
43.2K
Growth Rate:
77.49%
Total runs:
27.8K
Run Growth:
11.0K
Growth Rate:
30.16%
Total runs:
26.7K
Run Growth:
21.6K
Growth Rate:
72.16%
Total runs:
26.4K
Run Growth:
25.9K
Growth Rate:
99.99%
Total runs:
25.7K
Run Growth:
24.9K
Growth Rate:
94.56%
Total runs:
24.5K
Run Growth:
24.2K
Growth Rate:
98.87%
Total runs:
24.2K
Run Growth:
22.8K
Growth Rate:
93.02%
Total runs:
23.7K
Run Growth:
-1.4K
Growth Rate:
-5.87%
Total runs:
23.6K
Run Growth:
9.7K
Growth Rate:
41.88%
Total runs:
23.4K
Run Growth:
12.7K
Growth Rate:
50.75%
Total runs:
22.2K
Run Growth:
14.7K
Growth Rate:
63.93%
Total runs:
22.1K
Run Growth:
22.1K
Growth Rate:
100.00%
Total runs:
18.1K
Run Growth:
15.5K
Growth Rate:
100.00%
Total runs:
18.0K
Run Growth:
11.3K
Growth Rate:
63.98%
Total runs:
16.8K
Run Growth:
-4.3K
Growth Rate:
-23.06%
Total runs:
16.2K
Run Growth:
1.7K
Growth Rate:
10.47%
Total runs:
15.8K
Run Growth:
-2.2K
Growth Rate:
-13.85%
Total runs:
15.6K
Run Growth:
13.4K
Growth Rate:
83.77%
Total runs:
14.9K
Run Growth:
20.8K
Growth Rate:
87.21%
Total runs:
13.5K
Run Growth:
10.9K
Growth Rate:
80.36%
Total runs:
13.4K
Run Growth:
187
Growth Rate:
1.40%
Total runs:
13.2K
Run Growth:
12.8K
Growth Rate:
97.05%
Total runs:
13.0K
Run Growth:
9.0K
Growth Rate:
67.33%
Total runs:
12.8K
Run Growth:
11.2K
Growth Rate:
75.57%
Total runs:
11.4K
Run Growth:
3.8K
Growth Rate:
99.95%
Total runs:
11.2K
Run Growth:
9.4K
Growth Rate:
82.49%
Total runs:
11.2K
Run Growth:
11.1K
Growth Rate:
100.00%
Total runs:
10.9K
Run Growth:
9.8K
Growth Rate:
97.72%
Total runs:
10.5K
Run Growth:
-90
Growth Rate:
-0.85%
Total runs:
10.3K
Run Growth:
3.6K
Growth Rate:
34.97%
Total runs:
9.8K
Run Growth:
3.4K
Growth Rate:
22.70%
Total runs:
9.7K
Run Growth:
6.0K
Growth Rate:
62.14%
Total runs:
9.6K
Run Growth:
9.6K
Growth Rate:
99.49%
Total runs:
9.4K
Run Growth:
-8.3K
Growth Rate:
-81.29%
Total runs:
9.1K
Run Growth:
8.1K
Growth Rate:
89.27%
Total runs:
8.7K
Run Growth:
5.3K
Growth Rate:
61.45%
Total runs:
8.5K
Run Growth:
1.7K
Growth Rate:
19.98%
Total runs:
8.5K
Run Growth:
2.5K
Growth Rate:
29.15%
Total runs:
8.4K
Run Growth:
-1.9K
Growth Rate:
-21.47%
Total runs:
8.4K
Run Growth:
5.0K
Growth Rate:
58.40%
Total runs:
8.3K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
8.3K
Run Growth:
5.7K
Growth Rate:
69.87%
Total runs:
8.2K
Run Growth:
5.8K
Growth Rate:
75.17%
Total runs:
8.1K
Run Growth:
8.1K
Growth Rate:
100.00%
Total runs:
8.0K
Run Growth:
8.0K
Growth Rate:
99.61%
Total runs:
7.9K
Run Growth:
7.0K
Growth Rate:
87.92%
Total runs:
7.8K
Run Growth:
5.5K
Growth Rate:
70.26%
Total runs:
7.8K
Run Growth:
1.0K
Growth Rate:
19.39%
Total runs:
7.6K
Run Growth:
2.4K
Growth Rate:
31.75%
Total runs:
7.6K
Run Growth:
2.6K
Growth Rate:
34.02%
Total runs:
7.3K
Run Growth:
5.6K
Growth Rate:
74.58%
Total runs:
7.3K
Run Growth:
7.2K
Growth Rate:
99.01%
Total runs:
7.1K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
6.9K
Run Growth:
5.1K
Growth Rate:
74.29%
Total runs:
6.6K
Run Growth:
670
Growth Rate:
10.26%
Total runs:
6.6K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
6.5K
Run Growth:
6.2K
Growth Rate:
95.57%
Total runs:
6.5K
Run Growth:
2.0K
Growth Rate:
26.40%
Total runs:
6.4K
Run Growth:
2.1K
Growth Rate:
33.62%
Total runs:
6.3K
Run Growth:
4.7K
Growth Rate:
74.24%
Total runs:
6.3K
Run Growth:
2.5K
Growth Rate:
37.40%
Total runs:
6.2K
Run Growth:
5.8K
Growth Rate:
89.44%
Total runs:
6.2K
Run Growth:
6.2K
Growth Rate:
100.00%
Total runs:
6.2K
Run Growth:
1.3K
Growth Rate:
20.37%
Total runs:
6.0K
Run Growth:
5.5K
Growth Rate:
91.57%
Total runs:
5.9K
Run Growth:
-297
Growth Rate:
-5.03%
Total runs:
5.9K
Run Growth:
4.1K
Growth Rate:
70.74%
Total runs:
5.9K
Run Growth:
3.2K
Growth Rate:
54.23%
Total runs:
5.8K
Run Growth:
-3.8K
Growth Rate:
-64.80%
Total runs:
5.8K
Run Growth:
3.5K
Growth Rate:
56.84%
Total runs:
5.8K
Run Growth:
4.7K
Growth Rate:
80.00%
Total runs:
5.8K
Run Growth:
4.3K
Growth Rate:
74.33%
Total runs:
5.7K
Run Growth:
2.4K
Growth Rate:
41.83%
Total runs:
5.5K
Run Growth:
5.5K
Growth Rate:
99.53%
Total runs:
5.5K
Run Growth:
129
Growth Rate:
2.35%
Total runs:
5.5K
Run Growth:
2.5K
Growth Rate:
46.11%
Total runs:
5.4K
Run Growth:
3.7K
Growth Rate:
68.06%
Total runs:
5.3K
Run Growth:
3.6K
Growth Rate:
65.81%
Total runs:
5.3K
Run Growth:
523
Growth Rate:
9.91%
Total runs:
5.3K
Run Growth:
2.7K
Growth Rate:
49.04%
Total runs:
5.1K
Run Growth:
2.7K
Growth Rate:
54.95%
Total runs:
5.1K
Run Growth:
3.9K
Growth Rate:
73.62%
Total runs:
5.1K
Run Growth:
3.4K
Growth Rate:
68.60%
Total runs:
5.0K
Run Growth:
3.4K
Growth Rate:
67.77%
Total runs:
5.0K
Run Growth:
4.5K
Growth Rate:
93.90%