bigcode / octocoder

huggingface.co
Total runs: 286
24-hour runs: 0
7-day runs: -14
30-day runs: 93
Model's Last Updated: August 17 2023
text-generation

Introduction of octocoder

Model Details of octocoder

Octopack

Table of Contents

  1. Model Summary
  2. Use
  3. Training
  4. Citation

Model Summary

OctoCoder is an instruction tuned model with 15.5B parameters created by finetuning StarCoder on CommitPackFT & OASST as described in the OctoPack paper.

Use

Intended use

The model follows instructions provided in the input. You should always preface your input with "Question: " and finish it with "Answer:", for example: "Question: Please write a function in Python that performs bubble sort.\n\nAnswer:"

Feel free to share your generations in the Community tab!

Generation
# pip install -q transformers
from transformers import AutoModelForCausalLM, AutoTokenizer

checkpoint = "bigcode/octocoder"
device = "cuda" # for GPU usage or "cpu" for CPU usage

tokenizer = AutoTokenizer.from_pretrained(checkpoint)
model = AutoModelForCausalLM.from_pretrained(checkpoint).to(device)

inputs = tokenizer.encode("Question: Please write a function in Python that performs bubble sort.\n\nAnswer:", return_tensors="pt").to(device)
outputs = model.generate(inputs)
print(tokenizer.decode(outputs[0]))

Training

Model
  • Architecture: GPT-2 model with multi-query attention and Fill-in-the-Middle objective
  • Steps: 250k pretraining & 30 instruction tuning
  • Pretraining tokens: 1 trillion pretraining & 2M instruction tuning
  • Precision: bfloat16
Hardware
  • Pretraining:
    • GPUs: 512 Tesla A100
    • Training time: 24 days
  • Instruction tuning:
    • GPUs: 8 Tesla A100
    • Training time: 4 hours
Software

Citation

@article{muennighoff2023octopack,
      title={OctoPack: Instruction Tuning Code Large Language Models}, 
      author={Niklas Muennighoff and Qian Liu and Armel Zebaze and Qinkai Zheng and Binyuan Hui and Terry Yue Zhuo and Swayam Singh and Xiangru Tang and Leandro von Werra and Shayne Longpre},
      journal={arXiv preprint arXiv:2308.07124},
      year={2023}
}

Runs of bigcode octocoder on huggingface.co

286
Total runs
0
24-hour runs
-31
3-day runs
-14
7-day runs
93
30-day runs

More Information About octocoder huggingface.co Model

octocoder huggingface.co

octocoder huggingface.co is an AI model on huggingface.co that provides octocoder's model effect (), which can be used instantly with this bigcode octocoder model. huggingface.co supports a free trial of the octocoder model, and also provides paid use of the octocoder. Support call octocoder model through api, including Node.js, Python, http.

octocoder huggingface.co Url

https://huggingface.co/bigcode/octocoder

bigcode octocoder online free

octocoder huggingface.co is an online trial and call api platform, which integrates octocoder's modeling effects, including api services, and provides a free online trial of octocoder, you can try octocoder online for free by clicking the link below.

bigcode octocoder online free url in huggingface.co:

https://huggingface.co/bigcode/octocoder

octocoder install

octocoder is an open source model from GitHub that offers a free installation service, and any user can find octocoder on GitHub to install. At the same time, huggingface.co provides the effect of octocoder install, users can directly use octocoder installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

octocoder install url in huggingface.co:

https://huggingface.co/bigcode/octocoder

Url of octocoder

octocoder huggingface.co Url

Provider of octocoder huggingface.co

bigcode
ORGANIZATIONS

Other API from bigcode

huggingface.co

Total runs: 1.1M
Run Growth: 717.0K
Growth Rate: 68.17%
Updated: March 04 2024
huggingface.co

Total runs: 35.3K
Run Growth: 26.7K
Growth Rate: 78.08%
Updated: June 11 2024
huggingface.co

Total runs: 18.6K
Run Growth: 1.0K
Growth Rate: 5.67%
Updated: October 08 2024
huggingface.co

Total runs: 7.0K
Run Growth: -48.3K
Growth Rate: -719.62%
Updated: October 12 2023
huggingface.co

Total runs: 2.1K
Run Growth: -472
Growth Rate: -23.95%
Updated: May 10 2023
huggingface.co

Total runs: 1.6K
Run Growth: -1.9K
Growth Rate: -128.21%
Updated: May 11 2023
huggingface.co

Total runs: 376
Run Growth: -287
Growth Rate: -101.06%
Updated: July 24 2023
huggingface.co

Total runs: 159
Run Growth: -16
Growth Rate: -10.06%
Updated: August 17 2023
huggingface.co

Total runs: 25
Run Growth: -145
Growth Rate: -580.00%
Updated: August 13 2023
huggingface.co

Total runs: 19
Run Growth: 15
Growth Rate: 78.95%
Updated: January 01 2024
huggingface.co

Total runs: 18
Run Growth: 1
Growth Rate: 5.56%
Updated: August 05 2023
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated: February 28 2024
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated: January 14 2025