Total runs:
558.4K
Run Growth:
239.0K
Growth Rate:
43.67%
unsloth / Meta-Llama-3.1-405B-bnb-4bit
Model's Last Updated: September 11 2024
text-generation
Introduction of Meta-Llama-3.1-405B-bnb-4bit
Model Details of Meta-Llama-3.1-405B-bnb-4bit
Finetune Llama 3.1, Gemma 2, Mistral 2-5x faster with 70% less memory via Unsloth!
We have a free Google Colab Tesla T4 notebook for Llama 3.1 (8B) here: https://colab.research.google.com/drive/1Ys44kVvmeZtnICzWz0xgpRnrIOjZAuxp?usp=sharing
✨ Finetune for Free
All notebooks are beginner friendly ! Add your dataset, click "Run All", and you'll get a 2x faster finetuned model which can be exported to GGUF, vLLM or uploaded to Hugging Face.
| Unsloth supports | Free Notebooks | Performance | Memory use |
|---|---|---|---|
| Llama-3 8b | ▶️ Start on Colab | 2.4x faster | 58% less |
| Gemma 7b | ▶️ Start on Colab | 2.4x faster | 58% less |
| Mistral 7b | ▶️ Start on Colab | 2.2x faster | 62% less |
| Llama-2 7b | ▶️ Start on Colab | 2.2x faster | 43% less |
| TinyLlama | ▶️ Start on Colab | 3.9x faster | 74% less |
| CodeLlama 34b A100 | ▶️ Start on Colab | 1.9x faster | 27% less |
| Mistral 7b 1xT4 | ▶️ Start on Kaggle | 5x faster* | 62% less |
| DPO - Zephyr | ▶️ Start on Colab | 1.9x faster | 19% less |
- This conversational notebook is useful for ShareGPT ChatML / Vicuna templates.
- This text completion notebook is for raw text. This DPO notebook replicates Zephyr.
- * Kaggle has 2x T4s, but we use 1. Due to overhead, 1x T4 is 5x faster.
Runs of unsloth Meta-Llama-3.1-405B-bnb-4bit on huggingface.co
277.4K
Total runs
0
24-hour runs
7.8K
3-day runs
7.5K
7-day runs
128.5K
30-day runs
More Information About Meta-Llama-3.1-405B-bnb-4bit huggingface.co Model
Url of Meta-Llama-3.1-405B-bnb-4bit
Meta-Llama-3.1-405B-bnb-4bit huggingface.co Url
Provider of Meta-Llama-3.1-405B-bnb-4bit huggingface.co
Other API from unsloth
Updated: January 07 2025
Total runs:
533.7K
Run Growth:
149.5K
Growth Rate:
82.91%
Total runs:
352.1K
Run Growth:
-191.4K
Growth Rate:
-55.07%
Total runs:
279.6K
Run Growth:
279.1K
Growth Rate:
100.00%
Total runs:
263.5K
Run Growth:
-25.5K
Growth Rate:
-9.63%
Total runs:
227.2K
Run Growth:
-50.3K
Growth Rate:
-23.28%
Total runs:
145.5K
Run Growth:
133.4K
Growth Rate:
97.47%
Total runs:
135.7K
Run Growth:
98.5K
Growth Rate:
100.00%
Total runs:
118.1K
Run Growth:
-89.7K
Growth Rate:
-59.24%
Total runs:
118.1K
Run Growth:
102.5K
Growth Rate:
61.65%
Total runs:
85.6K
Run Growth:
-25.5K
Growth Rate:
-39.38%
Total runs:
84.4K
Run Growth:
31.2K
Growth Rate:
22.84%
Total runs:
82.8K
Run Growth:
92.5K
Growth Rate:
72.40%
Total runs:
76.5K
Run Growth:
23.9K
Growth Rate:
31.85%
Total runs:
76.0K
Run Growth:
30.9K
Growth Rate:
42.47%
Total runs:
73.5K
Run Growth:
3.1K
Growth Rate:
4.26%
Total runs:
64.4K
Run Growth:
-35
Growth Rate:
-0.08%
Total runs:
62.6K
Run Growth:
33.9K
Growth Rate:
53.61%
Total runs:
44.2K
Run Growth:
24.7K
Growth Rate:
99.89%
Total runs:
43.2K
Run Growth:
-4.7K
Growth Rate:
-10.92%
Total runs:
42.8K
Run Growth:
-18.2K
Growth Rate:
-43.02%
Total runs:
41.4K
Run Growth:
-21.8K
Growth Rate:
-52.30%
Total runs:
41.0K
Run Growth:
-1.3K
Growth Rate:
-57.10%
Total runs:
40.9K
Run Growth:
18.2K
Growth Rate:
26.71%
Total runs:
36.7K
Run Growth:
-4.0K
Growth Rate:
-8.53%
Total runs:
33.1K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
31.5K
Run Growth:
-5.5K
Growth Rate:
-17.53%
Total runs:
27.3K
Run Growth:
221
Growth Rate:
0.81%
Total runs:
26.5K
Run Growth:
-8.0K
Growth Rate:
-150.13%
Total runs:
26.3K
Run Growth:
22.3K
Growth Rate:
100.00%
Total runs:
26.1K
Run Growth:
-5.6K
Growth Rate:
-21.64%
Total runs:
21.7K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
21.0K
Run Growth:
29.1K
Growth Rate:
62.03%
Total runs:
18.5K
Run Growth:
1.9K
Growth Rate:
43.71%
Total runs:
18.3K
Run Growth:
-13.4K
Growth Rate:
-72.19%
Total runs:
18.2K
Run Growth:
-715
Growth Rate:
-7.24%
Total runs:
18.0K
Run Growth:
3.7K
Growth Rate:
22.16%
Total runs:
16.2K
Run Growth:
10.5K
Growth Rate:
99.16%
Total runs:
16.1K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
15.2K
Run Growth:
6.4K
Growth Rate:
42.68%
Total runs:
15.2K
Run Growth:
-1.6K
Growth Rate:
-12.55%
Total runs:
14.9K
Run Growth:
5.7K
Growth Rate:
60.33%
Total runs:
14.6K
Run Growth:
-1.1K
Growth Rate:
-3.98%
Total runs:
14.6K
Run Growth:
920
Growth Rate:
6.55%
Total runs:
13.9K
Run Growth:
3.5K
Growth Rate:
25.52%
Total runs:
13.7K
Run Growth:
4.3K
Growth Rate:
47.40%
Total runs:
13.4K
Run Growth:
80.2K
Growth Rate:
71.60%
Total runs:
13.3K
Run Growth:
-778
Growth Rate:
-5.96%
Total runs:
13.0K
Run Growth:
-5.9K
Growth Rate:
-45.90%
Total runs:
12.9K
Run Growth:
6.5K
Growth Rate:
98.58%
Total runs:
12.9K
Run Growth:
-5.4K
Growth Rate:
-42.20%
Total runs:
12.6K
Run Growth:
949
Growth Rate:
11.13%
Total runs:
11.3K
Run Growth:
5.7K
Growth Rate:
36.21%
Total runs:
11.3K
Run Growth:
-877
Growth Rate:
-7.68%
Total runs:
10.9K
Run Growth:
8.6K
Growth Rate:
78.27%
Total runs:
10.7K
Run Growth:
-27.0K
Growth Rate:
-240.73%
Total runs:
10.7K
Run Growth:
-787
Growth Rate:
-7.44%
Total runs:
9.8K
Run Growth:
5.3K
Growth Rate:
73.90%
Total runs:
9.7K
Run Growth:
-1.2K
Growth Rate:
-17.36%
Total runs:
9.7K
Run Growth:
-1.4K
Growth Rate:
-14.45%
Total runs:
9.7K
Run Growth:
3.0K
Growth Rate:
56.80%
Total runs:
9.3K
Run Growth:
2.2K
Growth Rate:
23.62%
Total runs:
9.2K
Run Growth:
4.8K
Growth Rate:
97.49%
Total runs:
9.0K
Run Growth:
3.8K
Growth Rate:
42.86%
Total runs:
8.4K
Run Growth:
-25.7K
Growth Rate:
-293.45%
Total runs:
8.2K
Run Growth:
7.0K
Growth Rate:
85.25%
Total runs:
7.7K
Run Growth:
4.2K
Growth Rate:
54.43%
Total runs:
7.5K
Run Growth:
1.2K
Growth Rate:
15.78%
Total runs:
7.4K
Run Growth:
1.6K
Growth Rate:
24.36%
Total runs:
7.3K
Run Growth:
5.2K
Growth Rate:
72.10%
Total runs:
7.2K
Run Growth:
3.8K
Growth Rate:
59.93%
Total runs:
7.2K
Run Growth:
2.6K
Growth Rate:
37.31%
Total runs:
7.1K
Run Growth:
2.8K
Growth Rate:
66.53%
Total runs:
6.8K
Run Growth:
4.9K
Growth Rate:
73.70%
Total runs:
6.7K
Run Growth:
6.2K
Growth Rate:
30.31%
Total runs:
6.5K
Run Growth:
-2.3K
Growth Rate:
-35.88%
Total runs:
6.3K
Run Growth:
1.7K
Growth Rate:
27.08%
Total runs:
6.3K
Run Growth:
4.7K
Growth Rate:
36.72%
Total runs:
6.0K
Run Growth:
1.2K
Growth Rate:
26.58%
Total runs:
5.8K
Run Growth:
1.8K
Growth Rate:
31.69%
Total runs:
5.6K
Run Growth:
3.1K
Growth Rate:
83.07%
Total runs:
5.5K
Run Growth:
3.6K
Growth Rate:
69.16%
Total runs:
5.4K
Run Growth:
743
Growth Rate:
67.98%
Total runs:
5.3K
Run Growth:
3.0K
Growth Rate:
56.74%
Total runs:
5.2K
Run Growth:
4.0K
Growth Rate:
75.28%
Total runs:
5.2K
Run Growth:
1.4K
Growth Rate:
80.13%
Total runs:
4.9K
Run Growth:
504
Growth Rate:
22.74%
Total runs:
4.8K
Run Growth:
-127
Growth Rate:
-2.67%
Total runs:
4.7K
Run Growth:
1.7K
Growth Rate:
39.04%
Total runs:
4.7K
Run Growth:
1.3K
Growth Rate:
32.92%
Total runs:
4.6K
Run Growth:
2.8K
Growth Rate:
63.36%
Total runs:
4.5K
Run Growth:
2.8K
Growth Rate:
61.86%
Total runs:
4.4K
Run Growth:
2.5K
Growth Rate:
61.38%
Total runs:
4.4K
Run Growth:
2.9K
Growth Rate:
65.78%