Total runs:
2.8M
Run Growth:
934.9K
Growth Rate:
33.34%
stabilityai / stable-code-instruct-3b
Model's Last Updated: July 10 2024
text-generation
Introduction of stable-code-instruct-3b
Model Details of stable-code-instruct-3b
Stable Code Instruct 3B
Try it out here: https://huggingface.co/spaces/stabilityai/stable-code-instruct-3b
Model Description
stable-code-instruct-3b
is a 2.7B billion parameter decoder-only language model tuned from
stable-code-3b
. This model was trained on a mix of publicly available datasets, synthetic datasets using
Direct Preference Optimization (DPO)
.
This instruct tune demonstrates state-of-the-art performance (compared to models of similar size) on the MultiPL-E metrics across multiple programming languages tested using BigCode's Evaluation Harness , and on the code portions of MT Bench . The model is finetuned to make it useable in tasks like,
- General purpose Code/Software Engineering like conversations.
- SQL related generation and conversation.
Please note: For commercial use, please refer to https://stability.ai/license .
Usage
Here's how you can run the model use the model:
import torch
from transformers import AutoModelForCausalLM, AutoTokenizer
tokenizer = AutoTokenizer.from_pretrained("stabilityai/stable-code-instruct-3b", trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained("stabilityai/stable-code-instruct-3b", torch_dtype=torch.bfloat16, trust_remote_code=True)
model.eval()
model = model.cuda()
messages = [
{
"role": "system",
"content": "You are a helpful and polite assistant",
},
{
"role": "user",
"content": "Write a simple website in HTML. When a user clicks the button, it shows a random joke from a list of 4 jokes."
},
]
prompt = tokenizer.apply_chat_template(messages, add_generation_prompt=True, tokenize=False)
inputs = tokenizer([prompt], return_tensors="pt").to(model.device)
tokens = model.generate(
**inputs,
max_new_tokens=1024,
temperature=0.5,
top_p=0.95,
top_k=100,
do_sample=True,
use_cache=True
)
output = tokenizer.batch_decode(tokens[:, inputs.input_ids.shape[-1]:], skip_special_tokens=False)[0]
Model Details
- Developed by : Stability AI
-
Model type
:
Stable Code Instruct 3Bmodel is an auto-regressive language model based on the transformer decoder architecture. - Language(s) : English
- Paper : Stable Code Technical Report
- Library : Alignment Handbook
- Finetuned from model : https://huggingface.co/stabilityai/stable-code-3b
- License : StabilityAI Community License .
- Commercial License : to use this model commercially, please refer to https://stability.ai/license
-
Contact
: For questions and comments about the model, please email
[email protected]
Performance
Multi-PL Benchmark:
| Model | Size | Avg | Python | C++ | JavaScript | Java | PHP | Rust |
|---|---|---|---|---|---|---|---|---|
| Codellama Instruct | 7B | 0.30 | 0.33 | 0.31 | 0.31 | 0.29 | 0.31 | 0.25 |
| Deepseek Instruct | 1.3B | 0.44 | 0.52 | 0.52 | 0.41 | 0.46 | 0.45 | 0.28 |
| Stable Code Instruct (SFT) | 3B | 0.44 | 0.55 | 0.45 | 0.42 | 0.42 | 0.44 | 0.32 |
| Stable Code Instruct (DPO) | 3B | 0.47 | 0.59 | 0.49 | 0.49 | 0.44 | 0.45 | 0.37 |
MT-Bench Coding:
| Model | Size | Score |
|---|---|---|
| DeepSeek Coder | 1.3B | 4.6 |
| Stable Code Instruct (DPO) | 3B | 5.8 (ours) |
| Stable Code Instruct (SFT) | 3B | 5.5 |
| DeepSeek Coder | 6.7B | 6.9 |
| CodeLlama Instruct | 7B | 3.55 |
| StarChat2 | 15B | 5.7 |
SQL Performance
| Model | Size | Date | Group By | Order By | Ratio | Join | Where |
|---|---|---|---|---|---|---|---|
| Stable Code Instruct (DPO) | 3B | 24.0% | 54.2% | 68.5% | 40.0% | 54.2% | 42.8% |
| DeepSeek-Coder Instruct | 1.3B | 24.0% | 37.1% | 51.4% | 34.3% | 45.7% | 45.7% |
| SQLCoder | 7B | 64.0% | 82.9% | 74.3% | 54.3% | 74.3% | 74.3% |
How to Cite
@misc{stable-code-instruct-3b,
url={[https://huggingface.co/stabilityai/stable-code-3b](https://huggingface.co/stabilityai/stable-code-instruct-3b)},
title={Stable Code 3B},
author={Phung, Duy, and Pinnaparaju, Nikhil and Adithyan, Reshinth and Zhuravinskyi, Maksym and Tow, Jonathan and Cooper, Nathan}
}
Runs of stabilityai stable-code-instruct-3b on huggingface.co
2.1K
Total runs
97
24-hour runs
205
3-day runs
536
7-day runs
222
30-day runs
More Information About stable-code-instruct-3b huggingface.co Model
Url of stable-code-instruct-3b
stable-code-instruct-3b huggingface.co Url
Provider of stable-code-instruct-3b huggingface.co
Other API from stabilityai
Updated: October 31 2023
Total runs:
1.3M
Run Growth:
692.2K
Growth Rate:
55.50%
Total runs:
992.7K
Run Growth:
83.7K
Growth Rate:
8.38%
Total runs:
865.3K
Run Growth:
669.0K
Growth Rate:
77.44%
Total runs:
599.5K
Run Growth:
261.6K
Growth Rate:
47.87%
Total runs:
390.4K
Run Growth:
243.1K
Growth Rate:
62.27%
Total runs:
272.0K
Run Growth:
-52.4K
Growth Rate:
-18.87%
Total runs:
251.4K
Run Growth:
-77.1K
Growth Rate:
-43.16%
Total runs:
229.4K
Run Growth:
60.1K
Growth Rate:
25.27%
Total runs:
206.5K
Run Growth:
85.8K
Growth Rate:
44.00%
Total runs:
146.6K
Run Growth:
3.4K
Growth Rate:
3.56%
Total runs:
135.0K
Run Growth:
72.3K
Growth Rate:
52.53%
Total runs:
132.8K
Run Growth:
112.9K
Growth Rate:
88.16%
Total runs:
117.8K
Run Growth:
-24.0K
Growth Rate:
-20.58%
Total runs:
117.2K
Run Growth:
-21.6K
Growth Rate:
-18.06%
Total runs:
104.1K
Run Growth:
79.9K
Growth Rate:
76.90%
Total runs:
79.4K
Run Growth:
-4.3K
Growth Rate:
-5.12%
Total runs:
49.3K
Run Growth:
-512
Growth Rate:
-1.06%
Total runs:
44.2K
Run Growth:
37.7K
Growth Rate:
35.58%
Total runs:
34.3K
Run Growth:
5.2K
Growth Rate:
15.03%
Total runs:
28.2K
Run Growth:
9.5K
Growth Rate:
33.98%
Total runs:
23.1K
Run Growth:
3.1K
Growth Rate:
13.15%
Total runs:
20.6K
Run Growth:
3.0K
Growth Rate:
14.60%
Total runs:
20.3K
Run Growth:
15.1K
Growth Rate:
74.08%
Total runs:
16.4K
Run Growth:
6.2K
Growth Rate:
37.40%
Total runs:
15.9K
Run Growth:
8.3K
Growth Rate:
50.00%
Total runs:
12.3K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
11.4K
Run Growth:
4.0K
Growth Rate:
34.11%
Total runs:
9.2K
Run Growth:
1.5K
Growth Rate:
16.15%
Total runs:
8.3K
Run Growth:
2.6K
Growth Rate:
31.36%
Total runs:
7.2K
Run Growth:
1.2K
Growth Rate:
16.06%
Total runs:
7.0K
Run Growth:
1.6K
Growth Rate:
23.41%
Total runs:
6.7K
Run Growth:
2.1K
Growth Rate:
32.64%
Total runs:
6.3K
Run Growth:
2.7K
Growth Rate:
41.57%
Total runs:
6.3K
Run Growth:
2.9K
Growth Rate:
45.19%
Total runs:
5.2K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
4.7K
Run Growth:
2.5K
Growth Rate:
54.28%
Total runs:
4.2K
Run Growth:
-326
Growth Rate:
-7.34%
Total runs:
2.7K
Run Growth:
1.6K
Growth Rate:
59.48%
Total runs:
2.7K
Run Growth:
1.3K
Growth Rate:
50.04%
Total runs:
2.3K
Run Growth:
-20
Growth Rate:
-0.88%
Total runs:
2.1K
Run Growth:
935
Growth Rate:
44.93%
Total runs:
2.1K
Run Growth:
1.1K
Growth Rate:
51.54%
Total runs:
2.1K
Run Growth:
-6.5K
Growth Rate:
-313.91%
Total runs:
1.9K
Run Growth:
1.1K
Growth Rate:
62.09%
Total runs:
1.8K
Run Growth:
1.1K
Growth Rate:
63.14%
Total runs:
1.7K
Run Growth:
225
Growth Rate:
13.59%
Total runs:
1.7K
Run Growth:
1.0K
Growth Rate:
62.57%
Total runs:
1.6K
Run Growth:
832
Growth Rate:
52.39%
Total runs:
1.6K
Run Growth:
833
Growth Rate:
51.07%
Total runs:
1.6K
Run Growth:
912
Growth Rate:
57.36%
Total runs:
1.2K
Run Growth:
645
Growth Rate:
53.53%
Total runs:
935
Run Growth:
471
Growth Rate:
49.95%
Total runs:
910
Run Growth:
92
Growth Rate:
100.00%
Total runs:
793
Run Growth:
0
Growth Rate:
0.00%
Total runs:
734
Run Growth:
270
Growth Rate:
36.78%
Total runs:
682
Run Growth:
537
Growth Rate:
78.74%
Total runs:
682
Run Growth:
411
Growth Rate:
60.26%
Total runs:
600
Run Growth:
0
Growth Rate:
0.00%
Total runs:
569
Run Growth:
0
Growth Rate:
0.00%
Total runs:
564
Run Growth:
270
Growth Rate:
47.87%
Total runs:
531
Run Growth:
271
Growth Rate:
100.00%
Total runs:
473
Run Growth:
318
Growth Rate:
67.23%
Total runs:
433
Run Growth:
410
Growth Rate:
92.76%
Total runs:
380
Run Growth:
-1.5K
Growth Rate:
-397.11%
Total runs:
358
Run Growth:
25
Growth Rate:
6.98%
Total runs:
315
Run Growth:
342
Growth Rate:
93.44%
Total runs:
313
Run Growth:
113
Growth Rate:
36.10%
Total runs:
292
Run Growth:
-1
Growth Rate:
-0.34%
Total runs:
249
Run Growth:
-10
Growth Rate:
-4.03%
Total runs:
217
Run Growth:
-42
Growth Rate:
-19.35%
Total runs:
173
Run Growth:
53
Growth Rate:
30.11%
Total runs:
148
Run Growth:
62
Growth Rate:
41.89%
Total runs:
146
Run Growth:
120
Growth Rate:
82.19%
Total runs:
143
Run Growth:
-117
Growth Rate:
-81.82%
Total runs:
127
Run Growth:
106
Growth Rate:
83.46%
Total runs:
126
Run Growth:
274
Growth Rate:
100.00%
Total runs:
84
Run Growth:
25
Growth Rate:
100.00%
Total runs:
40
Run Growth:
19
Growth Rate:
47.50%
Total runs:
37
Run Growth:
48
Growth Rate:
100.00%
Total runs:
35
Run Growth:
19
Growth Rate:
54.29%
Total runs:
22
Run Growth:
8
Growth Rate:
36.36%
Total runs:
6
Run Growth:
3
Growth Rate:
50.00%
Total runs:
5
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%