OctoCoder is an instruction tuned model with 15.5B parameters created by finetuning StarCoder on CommitPackFT & OASST as described in the OctoPack paper.
Extension of OpenAI's HumanEval to cover 3 scenarios across 6 languages
Use
Intended use
The model follows instructions provided in the input. You should always preface your input with "Question: " and finish it with "Answer:", for example: "Question: Please write a function in Python that performs bubble sort.\n\nAnswer:"
Feel free to share your generations in the Community tab!
Generation
# pip install -q transformersfrom transformers import AutoModelForCausalLM, AutoTokenizer
checkpoint = "bigcode/octocoder"
device = "cuda"# for GPU usage or "cpu" for CPU usage
tokenizer = AutoTokenizer.from_pretrained(checkpoint)
model = AutoModelForCausalLM.from_pretrained(checkpoint).to(device)
inputs = tokenizer.encode("Question: Please write a function in Python that performs bubble sort.\n\nAnswer:", return_tensors="pt").to(device)
outputs = model.generate(inputs)
print(tokenizer.decode(outputs[0]))
Training
Model
Architecture:
GPT-2 model with multi-query attention and Fill-in-the-Middle objective
@article{muennighoff2023octopack,
title={OctoPack: Instruction Tuning Code Large Language Models},
author={Niklas Muennighoff and Qian Liu and Armel Zebaze and Qinkai Zheng and Binyuan Hui and Terry Yue Zhuo and Swayam Singh and Xiangru Tang and Leandro von Werra and Shayne Longpre},
journal={arXiv preprint arXiv:2308.07124},
year={2023}
}
Runs of bigcode octocoder on huggingface.co
286
Total runs
0
24-hour runs
-31
3-day runs
-14
7-day runs
93
30-day runs
More Information About octocoder huggingface.co Model
octocoder huggingface.co is an AI model on huggingface.co that provides octocoder's model effect (), which can be used instantly with this bigcode octocoder model. huggingface.co supports a free trial of the octocoder model, and also provides paid use of the octocoder. Support call octocoder model through api, including Node.js, Python, http.
octocoder huggingface.co is an online trial and call api platform, which integrates octocoder's modeling effects, including api services, and provides a free online trial of octocoder, you can try octocoder online for free by clicking the link below.
bigcode octocoder online free url in huggingface.co:
octocoder is an open source model from GitHub that offers a free installation service, and any user can find octocoder on GitHub to install. At the same time, huggingface.co provides the effect of octocoder install, users can directly use octocoder installed effect in huggingface.co for debugging and trial. It also supports api for free installation.