Total runs:
564.8K
Run Growth:
149.5K
Growth Rate:
82.91%
unsloth / llama-3-70b-bnb-4bit
Model's Last Updated: November 22 2024
text-generation
Introduction of llama-3-70b-bnb-4bit
Model Details of llama-3-70b-bnb-4bit
Finetune Mistral, Gemma, Llama 2-5x faster with 70% less memory via Unsloth!
We have a Google Colab Tesla T4 notebook for Llama-3 8b here: https://colab.research.google.com/drive/135ced7oHytdxu3N2DNe1Z0kqjyYIkDXp?usp=sharing
✨ Finetune for Free
All notebooks are beginner friendly ! Add your dataset, click "Run All", and you'll get a 2x faster finetuned model which can be exported to GGUF, vLLM or uploaded to Hugging Face.
| Unsloth supports | Free Notebooks | Performance | Memory use |
|---|---|---|---|
| Llama-3 8b | ▶️ Start on Colab | 2.4x faster | 58% less |
| Gemma 7b | ▶️ Start on Colab | 2.4x faster | 58% less |
| Mistral 7b | ▶️ Start on Colab | 2.2x faster | 62% less |
| Llama-2 7b | ▶️ Start on Colab | 2.2x faster | 43% less |
| TinyLlama | ▶️ Start on Colab | 3.9x faster | 74% less |
| CodeLlama 34b A100 | ▶️ Start on Colab | 1.9x faster | 27% less |
| Mistral 7b 1xT4 | ▶️ Start on Kaggle | 5x faster* | 62% less |
| DPO - Zephyr | ▶️ Start on Colab | 1.9x faster | 19% less |
- This conversational notebook is useful for ShareGPT ChatML / Vicuna templates.
- This text completion notebook is for raw text. This DPO notebook replicates Zephyr.
- * Kaggle has 2x T4s, but we use 1. Due to overhead, 1x T4 is 5x faster.
Runs of unsloth llama-3-70b-bnb-4bit on huggingface.co
708
Total runs
0
24-hour runs
36
3-day runs
-73
7-day runs
-5.3K
30-day runs
More Information About llama-3-70b-bnb-4bit huggingface.co Model
Url of llama-3-70b-bnb-4bit
llama-3-70b-bnb-4bit huggingface.co Url
Provider of llama-3-70b-bnb-4bit huggingface.co
Other API from unsloth
Updated: December 10 2024
Total runs:
448.3K
Run Growth:
160.8K
Growth Rate:
34.54%
Total runs:
390.0K
Run Growth:
-3.0K
Growth Rate:
-0.78%
Total runs:
385.7K
Run Growth:
279.1K
Growth Rate:
100.00%
Total runs:
351.6K
Run Growth:
-25.5K
Growth Rate:
-39.38%
Total runs:
287.8K
Run Growth:
52.0K
Growth Rate:
17.99%
Total runs:
274.3K
Run Growth:
12.4K
Growth Rate:
4.57%
Total runs:
264.8K
Run Growth:
98.5K
Growth Rate:
100.00%
Total runs:
255.3K
Run Growth:
-50.3K
Growth Rate:
-23.28%
Total runs:
208.7K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
200.5K
Run Growth:
102.5K
Growth Rate:
61.65%
Total runs:
172.2K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
114.0K
Run Growth:
23.9K
Growth Rate:
31.85%
Total runs:
95.1K
Run Growth:
31.2K
Growth Rate:
22.84%
Total runs:
93.7K
Run Growth:
52.8K
Growth Rate:
56.00%
Total runs:
87.2K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
87.1K
Run Growth:
20.6K
Growth Rate:
23.65%
Total runs:
81.2K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
75.5K
Run Growth:
133.4K
Growth Rate:
97.47%
Total runs:
73.2K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
71.8K
Run Growth:
92.5K
Growth Rate:
72.40%
Total runs:
71.1K
Run Growth:
-287.8K
Growth Rate:
-416.78%
Total runs:
63.6K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
60.0K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
58.4K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
56.1K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
55.9K
Run Growth:
24.7K
Growth Rate:
99.89%
Total runs:
55.5K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
52.9K
Run Growth:
-35
Growth Rate:
-0.08%
Total runs:
49.7K
Run Growth:
10.4K
Growth Rate:
21.02%
Total runs:
49.0K
Run Growth:
10.5K
Growth Rate:
21.44%
Total runs:
46.5K
Run Growth:
15.8K
Growth Rate:
34.13%
Total runs:
43.9K
Run Growth:
18.2K
Growth Rate:
26.71%
Total runs:
42.0K
Run Growth:
-1.3K
Growth Rate:
-57.10%
Total runs:
40.0K
Run Growth:
-4.0K
Growth Rate:
-8.53%
Total runs:
37.3K
Run Growth:
-17.7K
Growth Rate:
-47.17%
Total runs:
36.9K
Run Growth:
7.9K
Growth Rate:
21.47%
Total runs:
31.6K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
31.5K
Run Growth:
18.5K
Growth Rate:
64.97%
Total runs:
27.3K
Run Growth:
-8.0K
Growth Rate:
-150.13%
Total runs:
26.6K
Run Growth:
-3.4K
Growth Rate:
-12.71%
Total runs:
25.6K
Run Growth:
22.3K
Growth Rate:
100.00%
Total runs:
25.5K
Run Growth:
29.1K
Growth Rate:
62.03%
Total runs:
23.0K
Run Growth:
-12.3K
Growth Rate:
-52.06%
Total runs:
22.9K
Run Growth:
10.5K
Growth Rate:
99.16%
Total runs:
21.0K
Run Growth:
9.5K
Growth Rate:
45.25%
Total runs:
20.3K
Run Growth:
10.7K
Growth Rate:
52.81%
Total runs:
19.4K
Run Growth:
-715
Growth Rate:
-7.24%
Total runs:
19.2K
Run Growth:
9.7K
Growth Rate:
50.59%
Total runs:
18.8K
Run Growth:
4.3K
Growth Rate:
47.40%
Total runs:
17.8K
Run Growth:
-1.1K
Growth Rate:
-3.98%
Total runs:
17.6K
Run Growth:
80.2K
Growth Rate:
71.60%
Total runs:
17.3K
Run Growth:
5.6K
Growth Rate:
32.48%
Total runs:
16.2K
Run Growth:
-4.9K
Growth Rate:
-28.38%
Total runs:
16.1K
Run Growth:
949
Growth Rate:
11.13%
Total runs:
16.0K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
15.9K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
15.8K
Run Growth:
5.7K
Growth Rate:
36.54%
Total runs:
15.6K
Run Growth:
1.4K
Growth Rate:
8.85%
Total runs:
15.6K
Run Growth:
4.8K
Growth Rate:
97.49%
Total runs:
14.3K
Run Growth:
5.7K
Growth Rate:
60.33%
Total runs:
14.3K
Run Growth:
-793
Growth Rate:
-5.58%
Total runs:
13.7K
Run Growth:
5.3K
Growth Rate:
73.90%
Total runs:
13.5K
Run Growth:
-1.6K
Growth Rate:
-12.55%
Total runs:
12.8K
Run Growth:
11.4K
Growth Rate:
89.01%
Total runs:
12.8K
Run Growth:
5.7K
Growth Rate:
36.21%
Total runs:
12.2K
Run Growth:
-1.2K
Growth Rate:
-17.36%
Total runs:
12.1K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
11.9K
Run Growth:
74
Growth Rate:
0.62%
Total runs:
11.7K
Run Growth:
5.1K
Growth Rate:
43.49%
Total runs:
11.2K
Run Growth:
1.9K
Growth Rate:
16.67%
Total runs:
11.0K
Run Growth:
-27.0K
Growth Rate:
-240.73%
Total runs:
11.0K
Run Growth:
5.6K
Growth Rate:
51.35%
Total runs:
10.6K
Run Growth:
3.2K
Growth Rate:
30.55%
Total runs:
10.3K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
10.2K
Run Growth:
8.0K
Growth Rate:
78.73%
Total runs:
10.2K
Run Growth:
8.1K
Growth Rate:
80.01%
Total runs:
10.2K
Run Growth:
3.0K
Growth Rate:
56.80%
Total runs:
10.2K
Run Growth:
4.3K
Growth Rate:
42.65%
Total runs:
9.6K
Run Growth:
2.8K
Growth Rate:
66.53%
Total runs:
9.3K
Run Growth:
743
Growth Rate:
67.98%
Total runs:
9.2K
Run Growth:
6.5K
Growth Rate:
98.58%
Total runs:
8.9K
Run Growth:
-25.7K
Growth Rate:
-293.45%
Total runs:
8.6K
Run Growth:
5.4K
Growth Rate:
63.09%
Total runs:
8.0K
Run Growth:
5.3K
Growth Rate:
66.16%
Total runs:
7.8K
Run Growth:
936
Growth Rate:
12.35%
Total runs:
7.7K
Run Growth:
1.2K
Growth Rate:
26.58%
Total runs:
7.3K
Run Growth:
3.8K
Growth Rate:
59.93%
Total runs:
7.0K
Run Growth:
1.4K
Growth Rate:
80.13%
Total runs:
6.8K
Run Growth:
1.7K
Growth Rate:
24.52%
Total runs:
6.6K
Run Growth:
1.4K
Growth Rate:
21.66%
Total runs:
6.6K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
6.4K
Run Growth:
4.7K
Growth Rate:
36.72%
Total runs:
6.3K
Run Growth:
3.9K
Growth Rate:
60.80%
Total runs:
6.3K
Run Growth:
-99
Growth Rate:
-2.90%