Total runs:
707.8K
Run Growth:
516.9K
Growth Rate:
73.02%
unsloth / llama-2-7b-bnb-4bit
Model's Last Updated: September 03 2024
text-generation
Introduction of llama-2-7b-bnb-4bit
Model Details of llama-2-7b-bnb-4bit
Finetune Mistral, Gemma, Llama 2-5x faster with 70% less memory via Unsloth!
Directly quantized 4bit model with
bitsandbytes
.
We have a Google Colab Tesla T4 notebook for Llama 7b here: https://colab.research.google.com/drive/1lBzz5KeZJKXjvivbYvmGarix9Ao6Wxe5?usp=sharing
✨ Finetune for Free
All notebooks are beginner friendly ! Add your dataset, click "Run All", and you'll get a 2x faster finetuned model which can be exported to GGUF, vLLM or uploaded to Hugging Face.
| Unsloth supports | Free Notebooks | Performance | Memory use |
|---|---|---|---|
| Gemma 7b | ▶️ Start on Colab | 2.4x faster | 58% less |
| Mistral 7b | ▶️ Start on Colab | 2.2x faster | 62% less |
| Llama-2 7b | ▶️ Start on Colab | 2.2x faster | 43% less |
| TinyLlama | ▶️ Start on Colab | 3.9x faster | 74% less |
| CodeLlama 34b A100 | ▶️ Start on Colab | 1.9x faster | 27% less |
| Mistral 7b 1xT4 | ▶️ Start on Kaggle | 5x faster* | 62% less |
| DPO - Zephyr | ▶️ Start on Colab | 1.9x faster | 19% less |
- This conversational notebook is useful for ShareGPT ChatML / Vicuna templates.
- This text completion notebook is for raw text. This DPO notebook replicates Zephyr.
- * Kaggle has 2x T4s, but we use 1. Due to overhead, 1x T4 is 5x faster.
Runs of unsloth llama-2-7b-bnb-4bit on huggingface.co
13.7K
Total runs
28
24-hour runs
598
3-day runs
1.1K
7-day runs
9.2K
30-day runs
More Information About llama-2-7b-bnb-4bit huggingface.co Model
Url of llama-2-7b-bnb-4bit
llama-2-7b-bnb-4bit huggingface.co Url
Provider of llama-2-7b-bnb-4bit huggingface.co
Other API from unsloth
Updated: Oktober 22 2024
Total runs:
136.1K
Run Growth:
60.3K
Growth Rate:
44.27%
Total runs:
100.4K
Run Growth:
14.8K
Growth Rate:
14.75%
Total runs:
44.2K
Run Growth:
43.7K
Growth Rate:
98.73%
Total runs:
22.7K
Run Growth:
8.2K
Growth Rate:
36.15%
Total runs:
19.8K
Run Growth:
-2.6K
Growth Rate:
-18.72%
Total runs:
18.0K
Run Growth:
-2.1K
Growth Rate:
-10.48%
Total runs:
17.2K
Run Growth:
8.1K
Growth Rate:
47.35%
Total runs:
10.5K
Run Growth:
452
Growth Rate:
4.32%
Total runs:
8.8K
Run Growth:
3.7K
Growth Rate:
41.14%
Total runs:
7.6K
Run Growth:
-8.2K
Growth Rate:
-108.58%
Total runs:
6.9K
Run Growth:
-3.0K
Growth Rate:
-43.82%
Total runs:
5.7K
Run Growth:
1.0K
Growth Rate:
17.56%
Total runs:
5.1K
Run Growth:
-1.4K
Growth Rate:
-27.95%
Total runs:
4.1K
Run Growth:
-461
Growth Rate:
-11.29%
Total runs:
4.0K
Run Growth:
313
Growth Rate:
7.67%
Total runs:
3.3K
Run Growth:
-6.1K
Growth Rate:
-182.39%
Total runs:
3.1K
Run Growth:
-1.3K
Growth Rate:
-43.04%
Total runs:
3.0K
Run Growth:
1.5K
Growth Rate:
51.01%
Total runs:
2.1K
Run Growth:
701
Growth Rate:
35.88%
Total runs:
2.1K
Run Growth:
-1.6K
Growth Rate:
-94.05%
Total runs:
1.9K
Run Growth:
-866
Growth Rate:
-46.81%
Total runs:
1.6K
Run Growth:
526
Growth Rate:
33.14%
Total runs:
1.3K
Run Growth:
-1.5K
Growth Rate:
-114.25%
Total runs:
1.2K
Run Growth:
856
Growth Rate:
70.22%
Total runs:
1.2K
Run Growth:
-284
Growth Rate:
-27.31%
Total runs:
1.1K
Run Growth:
699
Growth Rate:
60.36%
Total runs:
1.1K
Run Growth:
-595
Growth Rate:
-53.51%
Total runs:
1.0K
Run Growth:
-289
Growth Rate:
-28.61%
Total runs:
794
Run Growth:
-572
Growth Rate:
-72.04%
Total runs:
626
Run Growth:
-266
Growth Rate:
-42.49%
Total runs:
605
Run Growth:
-73
Growth Rate:
-12.56%
Total runs:
597
Run Growth:
-89
Growth Rate:
-14.96%
Total runs:
586
Run Growth:
-1.5K
Growth Rate:
-249.92%
Total runs:
576
Run Growth:
-28
Growth Rate:
-4.84%
Total runs:
468
Run Growth:
-4.7K
Growth Rate:
-990.36%
Total runs:
461
Run Growth:
-10
Growth Rate:
-2.17%
Total runs:
412
Run Growth:
52
Growth Rate:
12.62%
Total runs:
408
Run Growth:
-112
Growth Rate:
-27.32%
Total runs:
312
Run Growth:
85
Growth Rate:
27.24%
Total runs:
280
Run Growth:
-236
Growth Rate:
-85.51%
Total runs:
252
Run Growth:
274
Growth Rate:
81.07%
Total runs:
222
Run Growth:
128
Growth Rate:
57.66%
Total runs:
220
Run Growth:
-850
Growth Rate:
-386.36%
Total runs:
177
Run Growth:
54
Growth Rate:
30.51%
Total runs:
137
Run Growth:
-40
Growth Rate:
-29.20%
Total runs:
137
Run Growth:
68
Growth Rate:
49.64%
Total runs:
74
Run Growth:
-311
Growth Rate:
-398.72%
Total runs:
22
Run Growth:
-18
Growth Rate:
-85.71%
Total runs:
13
Run Growth:
-66
Growth Rate:
-507.69%
Total runs:
10
Run Growth:
-19
Growth Rate:
-190.00%
Total runs:
7
Run Growth:
1
Growth Rate:
14.29%
Total runs:
6
Run Growth:
-5
Growth Rate:
-83.33%