Total runs:
620.0K
Run Growth:
278.2K
Growth Rate:
45.29%
unsloth / Phi-3-mini-4k-instruct-bnb-4bit
Model's Last Updated: September 03 2024
text-generation
Introduction of Phi-3-mini-4k-instruct-bnb-4bit
Model Details of Phi-3-mini-4k-instruct-bnb-4bit
Reminder to use the dev version Transformers:
pip install git+https://github.com/huggingface/transformers.git
Finetune Phi-3, Llama 3, Gemma 2, Mistral 2-5x faster with 70% less memory via Unsloth!
Directly quantized 4bit model with
bitsandbytes
.
We have a Google Colab Tesla T4 notebook for Phi-3 (mini) here: https://colab.research.google.com/drive/1vIrqH5uYDQwsJ4-OO3DErvuv4pBgVwk4?usp=sharing And another notebook for Phi-3 (medium) here: https://colab.research.google.com/drive/1hhdhBa1j_hsymiW9m-WzxQtgqTH_NHqi?usp=sharing
✨ Finetune for Free
All notebooks are beginner friendly ! Add your dataset, click "Run All", and you'll get a 2x faster finetuned model which can be exported to GGUF, vLLM or uploaded to Hugging Face.
| Unsloth supports | Free Notebooks | Performance | Memory use |
|---|---|---|---|
| Llama 3 (8B) | ▶️ Start on Colab | 2.4x faster | 58% less |
| Gemma 2 (9B) | ▶️ Start on Colab | 2x faster | 63% less |
| Mistral (9B) | ▶️ Start on Colab | 2.2x faster | 62% less |
| Phi 3 (mini) | ▶️ Start on Colab | 2x faster | 50% less |
| Phi 3 (medium) | ▶️ Start on Colab | 2x faster | 50% less |
| TinyLlama | ▶️ Start on Colab | 3.9x faster | 74% less |
| CodeLlama (34B) A100 | ▶️ Start on Colab | 1.9x faster | 27% less |
| Mistral (7B) 1xT4 | ▶️ Start on Kaggle | 5x faster* | 62% less |
| DPO - Zephyr | ▶️ Start on Colab | 1.9x faster | 19% less |
- This conversational notebook is useful for ShareGPT ChatML / Vicuna templates.
- This text completion notebook is for raw text. This DPO notebook replicates Zephyr.
- * Kaggle has 2x T4s, but we use 1. Due to overhead, 1x T4 is 5x faster.
Runs of unsloth Phi-3-mini-4k-instruct-bnb-4bit on huggingface.co
42.3K
Total runs
0
24-hour runs
2.7K
3-day runs
11.3K
7-day runs
30.9K
30-day runs
More Information About Phi-3-mini-4k-instruct-bnb-4bit huggingface.co Model
Url of Phi-3-mini-4k-instruct-bnb-4bit
Phi-3-mini-4k-instruct-bnb-4bit huggingface.co Url
Provider of Phi-3-mini-4k-instruct-bnb-4bit huggingface.co
Other API from unsloth
Updated: February 02 2025
Total runs:
541.2K
Run Growth:
149.5K
Growth Rate:
82.91%
Total runs:
405.4K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
401.7K
Run Growth:
279.1K
Growth Rate:
100.00%
Total runs:
388.1K
Run Growth:
-25.5K
Growth Rate:
-39.38%
Total runs:
366.6K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
338.5K
Run Growth:
-8.4K
Growth Rate:
-2.39%
Total runs:
289.2K
Run Growth:
55.4K
Growth Rate:
19.36%
Total runs:
284.2K
Run Growth:
20.9K
Growth Rate:
7.26%
Total runs:
269.0K
Run Growth:
98.5K
Growth Rate:
100.00%
Total runs:
266.8K
Run Growth:
102.5K
Growth Rate:
61.65%
Total runs:
246.5K
Run Growth:
-50.3K
Growth Rate:
-23.28%
Total runs:
241.5K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
160.8K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
137.0K
Run Growth:
23.9K
Growth Rate:
31.85%
Total runs:
129.5K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
129.3K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
96.5K
Run Growth:
-265.2K
Growth Rate:
-290.81%
Total runs:
95.6K
Run Growth:
37.8K
Growth Rate:
39.41%
Total runs:
90.4K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
89.2K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
87.9K
Run Growth:
44.0K
Growth Rate:
48.66%
Total runs:
87.3K
Run Growth:
31.2K
Growth Rate:
22.84%
Total runs:
82.6K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
78.3K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
75.9K
Run Growth:
92.5K
Growth Rate:
72.40%
Total runs:
66.6K
Run Growth:
24.7K
Growth Rate:
99.89%
Total runs:
64.9K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
58.0K
Run Growth:
-35
Growth Rate:
-0.08%
Total runs:
55.9K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
52.9K
Run Growth:
17.0K
Growth Rate:
32.01%
Total runs:
46.1K
Run Growth:
19.0K
Growth Rate:
41.13%
Total runs:
43.6K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
40.9K
Run Growth:
16.8K
Growth Rate:
40.73%
Total runs:
38.9K
Run Growth:
18.2K
Growth Rate:
26.71%
Total runs:
37.9K
Run Growth:
10.5K
Growth Rate:
99.16%
Total runs:
36.0K
Run Growth:
-8.0K
Growth Rate:
-21.28%
Total runs:
35.1K
Run Growth:
-1.3K
Growth Rate:
-57.10%
Total runs:
30.2K
Run Growth:
-4.0K
Growth Rate:
-8.53%
Total runs:
29.1K
Run Growth:
-1.6K
Growth Rate:
-12.55%
Total runs:
29.1K
Run Growth:
374
Growth Rate:
1.31%
Total runs:
27.9K
Run Growth:
29.1K
Growth Rate:
62.03%
Total runs:
27.8K
Run Growth:
-8.0K
Growth Rate:
-150.13%
Total runs:
27.8K
Run Growth:
16.5K
Growth Rate:
62.33%
Total runs:
25.5K
Run Growth:
-27.2K
Growth Rate:
-103.62%
Total runs:
24.2K
Run Growth:
15.7K
Growth Rate:
66.43%
Total runs:
23.3K
Run Growth:
-3.2K
Growth Rate:
-47.13%
Total runs:
22.3K
Run Growth:
-715
Growth Rate:
-7.24%
Total runs:
20.9K
Run Growth:
-17.2K
Growth Rate:
-80.39%
Total runs:
20.2K
Run Growth:
11.2K
Growth Rate:
54.32%
Total runs:
20.2K
Run Growth:
-1.1K
Growth Rate:
-3.98%
Total runs:
18.6K
Run Growth:
4.3K
Growth Rate:
47.40%
Total runs:
18.3K
Run Growth:
6.0K
Growth Rate:
33.18%
Total runs:
18.3K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
18.3K
Run Growth:
80.2K
Growth Rate:
71.60%
Total runs:
17.0K
Run Growth:
5.7K
Growth Rate:
36.21%
Total runs:
16.6K
Run Growth:
4.8K
Growth Rate:
97.49%
Total runs:
16.6K
Run Growth:
133.4K
Growth Rate:
97.47%
Total runs:
16.4K
Run Growth:
4.9K
Growth Rate:
29.43%
Total runs:
15.9K
Run Growth:
-1.2K
Growth Rate:
-17.36%
Total runs:
15.9K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
15.7K
Run Growth:
949
Growth Rate:
11.13%
Total runs:
15.1K
Run Growth:
2.8K
Growth Rate:
66.53%
Total runs:
14.8K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
14.6K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
14.4K
Run Growth:
6.9K
Growth Rate:
49.22%
Total runs:
14.3K
Run Growth:
6.2K
Growth Rate:
45.47%
Total runs:
14.0K
Run Growth:
1.4K
Growth Rate:
9.67%
Total runs:
13.9K
Run Growth:
22.3K
Growth Rate:
100.00%
Total runs:
13.9K
Run Growth:
-4.3K
Growth Rate:
-29.61%
Total runs:
13.9K
Run Growth:
2.0K
Growth Rate:
14.61%
Total runs:
13.0K
Run Growth:
7.4K
Growth Rate:
55.64%
Total runs:
12.9K
Run Growth:
11.9K
Growth Rate:
96.18%
Total runs:
12.8K
Run Growth:
3.5K
Growth Rate:
28.79%
Total runs:
12.8K
Run Growth:
9.5K
Growth Rate:
76.71%
Total runs:
12.1K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
12.0K
Run Growth:
5.3K
Growth Rate:
73.90%
Total runs:
11.7K
Run Growth:
3.0K
Growth Rate:
56.80%
Total runs:
11.6K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
11.3K
Run Growth:
9.5K
Growth Rate:
86.40%
Total runs:
11.0K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
10.9K
Run Growth:
-27.0K
Growth Rate:
-240.73%
Total runs:
10.8K
Run Growth:
5.5K
Growth Rate:
51.96%
Total runs:
10.5K
Run Growth:
-25.7K
Growth Rate:
-293.45%
Total runs:
10.4K
Run Growth:
5.7K
Growth Rate:
60.33%
Total runs:
10.4K
Run Growth:
4.5K
Growth Rate:
43.46%
Total runs:
10.2K
Run Growth:
8.0K
Growth Rate:
78.02%
Total runs:
9.6K
Run Growth:
795
Growth Rate:
56.66%
Total runs:
9.6K
Run Growth:
5.9K
Growth Rate:
62.03%
Total runs:
9.6K
Run Growth:
743
Growth Rate:
67.98%
Total runs:
8.8K
Run Growth:
512
Growth Rate:
48.62%
Total runs:
8.5K
Run Growth:
1.6K
Growth Rate:
72.11%
Total runs:
8.5K
Run Growth:
997
Growth Rate:
77.59%
Total runs:
8.2K
Run Growth:
4.7K
Growth Rate:
36.72%
Total runs:
7.9K
Run Growth:
1.9K
Growth Rate:
43.71%
Total runs:
7.9K
Run Growth:
0
Growth Rate:
0.00%