Total runs:
436.5K
Run Growth:
279.1K
Growth Rate:
100.00%
unsloth / gemma-2-2b-bnb-4bit
Model's Last Updated: November 22 2024
text-generation
Introduction of gemma-2-2b-bnb-4bit
Model Details of gemma-2-2b-bnb-4bit
Reminder to use the dev version Transformers:
pip install git+https://github.com/huggingface/transformers.git
Finetune Gemma 2, Llama 3.1, Mistral 2-5x faster with 70% less memory via Unsloth!
Directly quantized 4bit model with
bitsandbytes
.
We have a Google Colab Tesla T4 notebook for Gemma 2 (2B) here: https://colab.research.google.com/drive/1weTpKOjBZxZJ5PQ-Ql8i6ptAY2x-FWVA?usp=sharing
We have a Google Colab Tesla T4 notebook for Gemma 2 (9B) here: https://colab.research.google.com/drive/1vIrqH5uYDQwsJ4-OO3DErvuv4pBgVwk4?usp=sharing
✨ Finetune for Free
All notebooks are beginner friendly ! Add your dataset, click "Run All", and you'll get a 2x faster finetuned model which can be exported to GGUF, vLLM or uploaded to Hugging Face.
| Unsloth supports | Free Notebooks | Performance | Memory use |
|---|---|---|---|
| Llama 3 (8B) | ▶️ Start on Colab | 2.4x faster | 58% less |
| Gemma 2 (9B) | ▶️ Start on Colab | 2x faster | 63% less |
| Mistral (9B) | ▶️ Start on Colab | 2.2x faster | 62% less |
| Phi 3 (mini) | ▶️ Start on Colab | 2x faster | 63% less |
| TinyLlama | ▶️ Start on Colab | 3.9x faster | 74% less |
| CodeLlama (34B) A100 | ▶️ Start on Colab | 1.9x faster | 27% less |
| Mistral (7B) 1xT4 | ▶️ Start on Kaggle | 5x faster* | 62% less |
| DPO - Zephyr | ▶️ Start on Colab | 1.9x faster | 19% less |
- This conversational notebook is useful for ShareGPT ChatML / Vicuna templates.
- This text completion notebook is for raw text. This DPO notebook replicates Zephyr.
- * Kaggle has 2x T4s, but we use 1. Due to overhead, 1x T4 is 5x faster.
Runs of unsloth gemma-2-2b-bnb-4bit on huggingface.co
12.8K
Total runs
-1.7K
24-hour runs
-2.4K
3-day runs
-2.5K
7-day runs
-8.7K
30-day runs
More Information About gemma-2-2b-bnb-4bit huggingface.co Model
Url of gemma-2-2b-bnb-4bit
gemma-2-2b-bnb-4bit huggingface.co Url
Provider of gemma-2-2b-bnb-4bit huggingface.co
Other API from unsloth
Updated: December 07 2024
Total runs:
380.8K
Run Growth:
149.5K
Growth Rate:
82.91%
Total runs:
368.9K
Run Growth:
-264.4K
Growth Rate:
-70.01%
Total runs:
355.3K
Run Growth:
240.7K
Growth Rate:
67.71%
Total runs:
349.0K
Run Growth:
-516.6K
Growth Rate:
-153.88%
Total runs:
267.5K
Run Growth:
259.7K
Growth Rate:
97.00%
Total runs:
256.2K
Run Growth:
133.4K
Growth Rate:
97.47%
Total runs:
233.3K
Run Growth:
-98.7K
Growth Rate:
-41.71%
Total runs:
192.1K
Run Growth:
102.5K
Growth Rate:
61.65%
Total runs:
182.5K
Run Growth:
-50.3K
Growth Rate:
-23.28%
Total runs:
129.2K
Run Growth:
98.5K
Growth Rate:
100.00%
Total runs:
93.8K
Run Growth:
31.2K
Growth Rate:
22.84%
Total runs:
91.0K
Run Growth:
92.5K
Growth Rate:
72.40%
Total runs:
66.6K
Run Growth:
23.9K
Growth Rate:
31.85%
Total runs:
64.0K
Run Growth:
-35
Growth Rate:
-0.08%
Total runs:
60.8K
Run Growth:
24.9K
Growth Rate:
39.75%
Total runs:
60.4K
Run Growth:
-25.5K
Growth Rate:
-39.38%
Total runs:
58.5K
Run Growth:
-25.7K
Growth Rate:
-42.72%
Total runs:
54.7K
Run Growth:
18.2K
Growth Rate:
26.71%
Total runs:
44.2K
Run Growth:
8.5K
Growth Rate:
19.70%
Total runs:
44.2K
Run Growth:
3.9K
Growth Rate:
9.09%
Total runs:
43.7K
Run Growth:
24.7K
Growth Rate:
99.89%
Total runs:
41.8K
Run Growth:
22.3K
Growth Rate:
100.00%
Total runs:
37.8K
Run Growth:
25.1K
Growth Rate:
66.96%
Total runs:
36.6K
Run Growth:
-4.0K
Growth Rate:
-8.53%
Total runs:
36.3K
Run Growth:
-45.1K
Growth Rate:
-123.46%
Total runs:
28.3K
Run Growth:
-31.6K
Growth Rate:
-110.15%
Total runs:
27.4K
Run Growth:
-31.8K
Growth Rate:
-115.11%
Total runs:
25.1K
Run Growth:
-24.7K
Growth Rate:
-94.08%
Total runs:
18.3K
Run Growth:
29.1K
Growth Rate:
62.03%
Total runs:
18.2K
Run Growth:
-12.9K
Growth Rate:
-64.10%
Total runs:
18.0K
Run Growth:
1.9K
Growth Rate:
43.71%
Total runs:
17.3K
Run Growth:
80.2K
Growth Rate:
71.60%
Total runs:
16.6K
Run Growth:
10.5K
Growth Rate:
99.16%
Total runs:
14.5K
Run Growth:
-1.1K
Growth Rate:
-3.98%
Total runs:
14.3K
Run Growth:
5.7K
Growth Rate:
60.33%
Total runs:
13.6K
Run Growth:
-1.6K
Growth Rate:
-12.55%
Total runs:
12.7K
Run Growth:
5.7K
Growth Rate:
36.21%
Total runs:
12.4K
Run Growth:
6.5K
Growth Rate:
98.58%
Total runs:
12.3K
Run Growth:
1.3K
Growth Rate:
9.97%
Total runs:
11.9K
Run Growth:
5.4K
Growth Rate:
44.87%
Total runs:
11.4K
Run Growth:
-27.0K
Growth Rate:
-240.73%
Total runs:
11.3K
Run Growth:
-715
Growth Rate:
-7.24%
Total runs:
11.3K
Run Growth:
-12.9K
Growth Rate:
-119.97%
Total runs:
10.4K
Run Growth:
434
Growth Rate:
3.93%
Total runs:
10.0K
Run Growth:
4.8K
Growth Rate:
97.49%
Total runs:
9.4K
Run Growth:
8.3K
Growth Rate:
89.09%
Total runs:
9.3K
Run Growth:
949
Growth Rate:
11.13%
Total runs:
9.1K
Run Growth:
-4.6K
Growth Rate:
-48.35%
Total runs:
9.0K
Run Growth:
-2.9K
Growth Rate:
-31.35%
Total runs:
8.9K
Run Growth:
-7.9K
Growth Rate:
-87.10%
Total runs:
8.2K
Run Growth:
-2.7K
Growth Rate:
-31.66%
Total runs:
8.0K
Run Growth:
4.7K
Growth Rate:
36.72%
Total runs:
7.9K
Run Growth:
-25.7K
Growth Rate:
-293.45%
Total runs:
7.4K
Run Growth:
5.3K
Growth Rate:
73.90%
Total runs:
7.4K
Run Growth:
3.8K
Growth Rate:
51.48%
Total runs:
7.3K
Run Growth:
4.3K
Growth Rate:
47.40%
Total runs:
7.3K
Run Growth:
-5.1K
Growth Rate:
-69.67%
Total runs:
7.3K
Run Growth:
1.9K
Growth Rate:
25.55%
Total runs:
7.2K
Run Growth:
-3.9K
Growth Rate:
-50.23%
Total runs:
7.0K
Run Growth:
-744
Growth Rate:
-10.22%
Total runs:
7.0K
Run Growth:
6.7K
Growth Rate:
100.00%
Total runs:
6.9K
Run Growth:
6.2K
Growth Rate:
30.31%
Total runs:
6.2K
Run Growth:
-1.3K
Growth Rate:
-57.10%
Total runs:
6.0K
Run Growth:
1.2K
Growth Rate:
26.58%
Total runs:
6.0K
Run Growth:
-1.2K
Growth Rate:
-19.51%
Total runs:
5.8K
Run Growth:
3.8K
Growth Rate:
65.33%
Total runs:
5.6K
Run Growth:
1.3K
Growth Rate:
32.92%
Total runs:
5.6K
Run Growth:
3.8K
Growth Rate:
59.93%
Total runs:
5.6K
Run Growth:
3.0K
Growth Rate:
56.80%
Total runs:
5.6K
Run Growth:
813
Growth Rate:
14.18%
Total runs:
5.5K
Run Growth:
-330
Growth Rate:
-6.00%
Total runs:
5.4K
Run Growth:
-4.1K
Growth Rate:
-72.98%
Total runs:
5.2K
Run Growth:
3.1K
Growth Rate:
83.07%
Total runs:
5.2K
Run Growth:
2.5K
Growth Rate:
49.32%
Total runs:
4.9K
Run Growth:
569
Growth Rate:
11.21%
Total runs:
4.9K
Run Growth:
2.5K
Growth Rate:
48.97%
Total runs:
4.9K
Run Growth:
-1.2K
Growth Rate:
-17.36%
Total runs:
4.8K
Run Growth:
-3.2K
Growth Rate:
-47.13%
Total runs:
4.7K
Run Growth:
2.0K
Growth Rate:
43.99%
Total runs:
4.4K
Run Growth:
2.8K
Growth Rate:
66.53%
Total runs:
4.2K
Run Growth:
3.4K
Growth Rate:
82.04%
Total runs:
4.2K
Run Growth:
-2.0K
Growth Rate:
-48.10%
Total runs:
4.0K
Run Growth:
-99
Growth Rate:
-2.90%
Total runs:
4.0K
Run Growth:
5.6K
Growth Rate:
66.21%
Total runs:
4.0K
Run Growth:
-8.9K
Growth Rate:
-260.55%
Total runs:
3.7K
Run Growth:
-2.5K
Growth Rate:
-65.67%
Total runs:
3.5K
Run Growth:
2.8K
Growth Rate:
80.66%
Total runs:
3.5K
Run Growth:
4.4K
Growth Rate:
49.99%
Total runs:
3.4K
Run Growth:
1.2K
Growth Rate:
36.69%
Total runs:
3.4K
Run Growth:
2.2K
Growth Rate:
100.00%
Total runs:
3.3K
Run Growth:
-2.5K
Growth Rate:
-72.04%
Total runs:
3.3K
Run Growth:
443
Growth Rate:
13.37%