bigcode / octogeex

huggingface.co
Total runs: 159
24-hour runs: 0
7-day runs: 33
30-day runs: -16
Model's Last Updated: August 17 2023
text-generation

Introduction of octogeex

Model Details of octogeex

Octopack

Table of Contents

  1. Model Summary
  2. Use
  3. Training
  4. License
  5. Citation

Model Summary

OctoGeeX is an instruction tuned model with 6B parameters created by fine-tuning CodeGeeX2 on CommitPackFT & OASST as described in the OctoPack paper.

Use

Intended use

The model follows instructions provided in the input. You should always preface your input with "Question: " and finish it with "Answer:", for example: "Question: Please write a function in Python that performs bubble sort.\n\nAnswer:"

Feel free to share your generations in the Community tab!

Generation
# pip install -q transformers
from transformers import AutoModelForCausalLM, AutoTokenizer

checkpoint = "bigcode/octogeex"
device = "cuda" # for GPU usage or "cpu" for CPU usage

tokenizer = AutoTokenizer.from_pretrained(checkpoint)
model = AutoModelForCausalLM.from_pretrained(checkpoint).to(device)

inputs = tokenizer.encode("Question: Please write a function in Python that performs bubble sort.\n\nAnswer:", return_tensors="pt").to(device)
outputs = model.generate(inputs)
print(tokenizer.decode(outputs[0]))

Training

Model
  • Architecture: GPT-2 model with multi-query attention and Fill-in-the-Middle objective
  • Steps: 250k pretraining & 30 instruction tuning
  • Pretraining tokens: 1 trillion pretraining & 2M instruction tuning
  • Precision: bfloat16
Hardware
  • Pretraining:
    • GPUs: 512 Tesla A100
    • Training time: 24 days
  • Instruction tuning:
    • GPUs: 8 Tesla A100
    • Training time: 4 hours
Software

License

本仓库的代码依照 Apache-2.0 协议开源,模型的权重的使用则需要遵循 Model License

The code in this repository is open-source under the MIT license . The model weights are licensed under the Model License , please apply for commercial use by filling the registration form .

Citation

@article{muennighoff2023octopack,
      title={OctoPack: Instruction Tuning Code Large Language Models}, 
      author={Niklas Muennighoff and Qian Liu and Armel Zebaze and Qinkai Zheng and Binyuan Hui and Terry Yue Zhuo and Swayam Singh and Xiangru Tang and Leandro von Werra and Shayne Longpre},
      journal={arXiv preprint arXiv:2308.07124},
      year={2023}
}

Runs of bigcode octogeex on huggingface.co

159
Total runs
0
24-hour runs
17
3-day runs
33
7-day runs
-16
30-day runs

More Information About octogeex huggingface.co Model

octogeex huggingface.co

octogeex huggingface.co is an AI model on huggingface.co that provides octogeex's model effect (), which can be used instantly with this bigcode octogeex model. huggingface.co supports a free trial of the octogeex model, and also provides paid use of the octogeex. Support call octogeex model through api, including Node.js, Python, http.

bigcode octogeex online free

octogeex huggingface.co is an online trial and call api platform, which integrates octogeex's modeling effects, including api services, and provides a free online trial of octogeex, you can try octogeex online for free by clicking the link below.

bigcode octogeex online free url in huggingface.co:

https://huggingface.co/bigcode/octogeex

octogeex install

octogeex is an open source model from GitHub that offers a free installation service, and any user can find octogeex on GitHub to install. At the same time, huggingface.co provides the effect of octogeex install, users can directly use octogeex installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

octogeex install url in huggingface.co:

https://huggingface.co/bigcode/octogeex

Url of octogeex

octogeex huggingface.co Url

Provider of octogeex huggingface.co

bigcode
ORGANIZATIONS

Other API from bigcode

huggingface.co

Total runs: 1.1M
Run Growth: 717.0K
Growth Rate: 68.17%
Updated: March 04 2024
huggingface.co

Total runs: 35.3K
Run Growth: 26.7K
Growth Rate: 78.08%
Updated: June 11 2024
huggingface.co

Total runs: 18.6K
Run Growth: 1.0K
Growth Rate: 5.67%
Updated: October 08 2024
huggingface.co

Total runs: 7.0K
Run Growth: -48.3K
Growth Rate: -719.62%
Updated: October 12 2023
huggingface.co

Total runs: 2.1K
Run Growth: -472
Growth Rate: -23.95%
Updated: May 10 2023
huggingface.co

Total runs: 1.6K
Run Growth: -1.9K
Growth Rate: -128.21%
Updated: May 11 2023
huggingface.co

Total runs: 376
Run Growth: -287
Growth Rate: -101.06%
Updated: July 24 2023
huggingface.co

Total runs: 286
Run Growth: 93
Growth Rate: 32.52%
Updated: August 17 2023
huggingface.co

Total runs: 25
Run Growth: -145
Growth Rate: -580.00%
Updated: August 13 2023
huggingface.co

Total runs: 19
Run Growth: 15
Growth Rate: 78.95%
Updated: January 01 2024
huggingface.co

Total runs: 18
Run Growth: 1
Growth Rate: 5.56%
Updated: August 05 2023
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated: February 28 2024
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated: January 14 2025