Total runs:
4.4M
Run Growth:
4.2M
Growth Rate:
95.28%
unsloth / gemma-2-9b-bnb-4bit
Model's Last Updated: November 22 2024
text-generation
Introduction of gemma-2-9b-bnb-4bit
Model Details of gemma-2-9b-bnb-4bit
Reminder to use the dev version Transformers:
pip install git+https://github.com/huggingface/transformers.git
Finetune Gemma, Llama 3, Mistral 2-5x faster with 70% less memory via Unsloth!
Directly quantized 4bit model with
bitsandbytes
.
We have a Google Colab Tesla T4 notebook for Gemma 2 (9B) here: https://colab.research.google.com/drive/1vIrqH5uYDQwsJ4-OO3DErvuv4pBgVwk4?usp=sharing
✨ Finetune for Free
All notebooks are beginner friendly ! Add your dataset, click "Run All", and you'll get a 2x faster finetuned model which can be exported to GGUF, vLLM or uploaded to Hugging Face.
| Unsloth supports | Free Notebooks | Performance | Memory use |
|---|---|---|---|
| Llama 3 (8B) | ▶️ Start on Colab | 2.4x faster | 58% less |
| Gemma 2 (9B) | ▶️ Start on Colab | 2x faster | 63% less |
| Mistral (9B) | ▶️ Start on Colab | 2.2x faster | 62% less |
| Phi 3 (mini) | ▶️ Start on Colab | 2x faster | 63% less |
| TinyLlama | ▶️ Start on Colab | 3.9x faster | 74% less |
| CodeLlama (34B) A100 | ▶️ Start on Colab | 1.9x faster | 27% less |
| Mistral (7B) 1xT4 | ▶️ Start on Kaggle | 5x faster* | 62% less |
| DPO - Zephyr | ▶️ Start on Colab | 1.9x faster | 19% less |
- This conversational notebook is useful for ShareGPT ChatML / Vicuna templates.
- This text completion notebook is for raw text. This DPO notebook replicates Zephyr.
- * Kaggle has 2x T4s, but we use 1. Due to overhead, 1x T4 is 5x faster.
Runs of unsloth gemma-2-9b-bnb-4bit on huggingface.co
41.4K
Total runs
0
24-hour runs
749
3-day runs
2.9K
7-day runs
-5.1K
30-day runs
More Information About gemma-2-9b-bnb-4bit huggingface.co Model
Url of gemma-2-9b-bnb-4bit
gemma-2-9b-bnb-4bit huggingface.co Url
Provider of gemma-2-9b-bnb-4bit huggingface.co
Other API from unsloth
Updated: February 13 2025
Total runs:
874.5K
Run Growth:
484.5K
Growth Rate:
55.40%
Total runs:
799.0K
Run Growth:
582.2K
Growth Rate:
74.38%
Total runs:
766.8K
Run Growth:
703.2K
Growth Rate:
91.71%
Total runs:
591.2K
Run Growth:
513.3K
Growth Rate:
85.48%
Total runs:
536.0K
Run Growth:
363.8K
Growth Rate:
67.87%
Total runs:
411.0K
Run Growth:
356.0K
Growth Rate:
85.59%
Total runs:
347.6K
Run Growth:
-48.4K
Growth Rate:
-13.92%
Total runs:
322.1K
Run Growth:
292.9K
Growth Rate:
90.27%
Total runs:
316.2K
Run Growth:
-239.3K
Growth Rate:
-75.69%
Total runs:
310.5K
Run Growth:
294.5K
Growth Rate:
94.87%
Total runs:
291.9K
Run Growth:
227.3K
Growth Rate:
75.64%
Total runs:
246.6K
Run Growth:
246.0K
Growth Rate:
99.74%
Total runs:
210.2K
Run Growth:
-64.1K
Growth Rate:
-30.49%
Total runs:
203.3K
Run Growth:
-84.5K
Growth Rate:
-41.56%
Total runs:
161.1K
Run Growth:
73.0K
Growth Rate:
45.31%
Total runs:
145.6K
Run Growth:
90.1K
Growth Rate:
61.89%
Total runs:
138.6K
Run Growth:
67.5K
Growth Rate:
48.67%
Total runs:
131.4K
Run Growth:
-225.9K
Growth Rate:
-171.91%
Total runs:
130.9K
Run Growth:
129.8K
Growth Rate:
99.49%
Total runs:
130.8K
Run Growth:
125.1K
Growth Rate:
98.06%
Total runs:
122.7K
Run Growth:
93.2K
Growth Rate:
94.97%
Total runs:
116.0K
Run Growth:
-2.0K
Growth Rate:
-1.71%
Total runs:
108.1K
Run Growth:
-340.2K
Growth Rate:
-314.70%
Total runs:
92.5K
Run Growth:
36.0K
Growth Rate:
39.12%
Total runs:
89.0K
Run Growth:
88.6K
Growth Rate:
99.61%
Total runs:
86.0K
Run Growth:
85.7K
Growth Rate:
99.67%
Total runs:
85.5K
Run Growth:
29.6K
Growth Rate:
34.62%
Total runs:
83.4K
Run Growth:
77.0K
Growth Rate:
93.69%
Total runs:
81.3K
Run Growth:
28.0K
Growth Rate:
34.52%
Total runs:
75.7K
Run Growth:
-179.6K
Growth Rate:
-237.29%
Total runs:
65.4K
Run Growth:
-29.7K
Growth Rate:
-45.42%
Total runs:
64.6K
Run Growth:
-7.3K
Growth Rate:
-11.33%
Total runs:
63.9K
Run Growth:
55.5K
Growth Rate:
89.71%
Total runs:
60.8K
Run Growth:
7.1K
Growth Rate:
11.76%
Total runs:
53.9K
Run Growth:
4.2K
Growth Rate:
7.81%
Total runs:
53.6K
Run Growth:
33.9K
Growth Rate:
65.19%
Total runs:
53.1K
Run Growth:
36.6K
Growth Rate:
68.98%
Total runs:
50.4K
Run Growth:
33.7K
Growth Rate:
66.90%
Total runs:
48.8K
Run Growth:
-216.0K
Growth Rate:
-442.22%
Total runs:
48.3K
Run Growth:
28.2K
Growth Rate:
57.99%
Total runs:
45.9K
Run Growth:
34.6K
Growth Rate:
83.96%
Total runs:
42.1K
Run Growth:
-1.8K
Growth Rate:
-3.26%
Total runs:
40.2K
Run Growth:
39.1K
Growth Rate:
100.00%
Total runs:
39.5K
Run Growth:
30.7K
Growth Rate:
77.85%
Total runs:
38.8K
Run Growth:
28.6K
Growth Rate:
73.71%
Total runs:
38.4K
Run Growth:
34.3K
Growth Rate:
90.63%
Total runs:
38.2K
Run Growth:
11.7K
Growth Rate:
30.67%
Total runs:
37.7K
Run Growth:
-56.0K
Growth Rate:
-148.65%
Total runs:
35.8K
Run Growth:
31.8K
Growth Rate:
90.34%
Total runs:
33.9K
Run Growth:
-33.5K
Growth Rate:
-97.69%
Total runs:
32.6K
Run Growth:
-4.2K
Growth Rate:
-12.73%
Total runs:
32.3K
Run Growth:
22.3K
Growth Rate:
70.81%
Total runs:
31.7K
Run Growth:
31.6K
Growth Rate:
99.57%
Total runs:
30.8K
Run Growth:
26.2K
Growth Rate:
84.99%
Total runs:
30.5K
Run Growth:
17.3K
Growth Rate:
56.28%
Total runs:
28.7K
Run Growth:
26.6K
Growth Rate:
92.28%
Total runs:
28.6K
Run Growth:
8.2K
Growth Rate:
28.75%
Total runs:
28.2K
Run Growth:
-53.0K
Growth Rate:
-188.16%
Total runs:
28.2K
Run Growth:
27.6K
Growth Rate:
99.11%
Total runs:
27.2K
Run Growth:
23.4K
Growth Rate:
87.94%
Total runs:
26.9K
Run Growth:
24.9K
Growth Rate:
92.81%
Total runs:
26.8K
Run Growth:
26.8K
Growth Rate:
99.83%
Total runs:
26.8K
Run Growth:
17.1K
Growth Rate:
65.09%
Total runs:
26.0K
Run Growth:
17.1K
Growth Rate:
65.80%
Total runs:
25.0K
Run Growth:
20.6K
Growth Rate:
82.48%
Total runs:
24.4K
Run Growth:
10.4K
Growth Rate:
43.55%
Total runs:
23.9K
Run Growth:
-20.0K
Growth Rate:
-83.60%
Total runs:
23.5K
Run Growth:
-4.5K
Growth Rate:
-16.87%
Total runs:
23.1K
Run Growth:
5.0K
Growth Rate:
21.72%
Total runs:
23.0K
Run Growth:
-14.4K
Growth Rate:
-62.53%
Total runs:
22.4K
Run Growth:
13.4K
Growth Rate:
59.63%
Total runs:
22.1K
Run Growth:
13.0K
Growth Rate:
64.09%
Total runs:
22.0K
Run Growth:
10.0K
Growth Rate:
45.21%
Total runs:
20.3K
Run Growth:
-650
Growth Rate:
-3.20%
Total runs:
20.2K
Run Growth:
20.0K
Growth Rate:
100.00%
Total runs:
20.1K
Run Growth:
19.7K
Growth Rate:
99.03%
Total runs:
19.7K
Run Growth:
3.7K
Growth Rate:
19.08%
Total runs:
18.9K
Run Growth:
17.9K
Growth Rate:
95.01%
Total runs:
17.9K
Run Growth:
-27.5K
Growth Rate:
-153.37%
Total runs:
17.8K
Run Growth:
-1.2K
Growth Rate:
-6.34%
Total runs:
17.1K
Run Growth:
-307
Growth Rate:
-1.79%
Total runs:
15.8K
Run Growth:
4.6K
Growth Rate:
29.01%
Total runs:
15.7K
Run Growth:
-7.3K
Growth Rate:
-46.22%
Total runs:
15.7K
Run Growth:
9.0K
Growth Rate:
58.31%
Total runs:
15.3K
Run Growth:
729
Growth Rate:
4.81%
Total runs:
15.3K
Run Growth:
2.9K
Growth Rate:
18.68%
Total runs:
15.1K
Run Growth:
-25.0K
Growth Rate:
-165.57%
Total runs:
15.0K
Run Growth:
-3.7K
Growth Rate:
-24.30%
Total runs:
14.8K
Run Growth:
529
Growth Rate:
3.58%
Total runs:
14.5K
Run Growth:
7.1K
Growth Rate:
49.33%
Total runs:
14.4K
Run Growth:
14.4K
Growth Rate:
99.98%
Total runs:
14.1K
Run Growth:
7.7K
Growth Rate:
56.69%
Total runs:
14.1K
Run Growth:
-2.3K
Growth Rate:
-17.06%
Total runs:
13.8K
Run Growth:
1.3K
Growth Rate:
9.39%
Total runs:
13.6K
Run Growth:
8.0K
Growth Rate:
58.54%
Total runs:
13.4K
Run Growth:
8.7K
Growth Rate:
64.79%
Total runs:
12.7K
Run Growth:
55
Growth Rate:
0.43%
Total runs:
12.6K
Run Growth:
-12.3K
Growth Rate:
-93.85%