bigcode / santacoderpack

huggingface.co
Total runs: 175
24-hour runs: 0
7-day runs: -32
30-day runs: 0
Model's Last Updated: Agosto 16 2023
text-generation

Introduction of santacoderpack

Model Details of santacoderpack

Octopack

Table of Contents

  1. Model Summary
  2. Use
  3. Training
  4. Citation

Model Summary

SantaCoderPack is an pre-trained model with the same architecture of SantaCoder on CommitPack using this format:

<commit_before>code_before<commit_msg>message<commit_after>code_after

Use

Intended use

The model follows instructions provided in the input. We recommend prefacing your input with "def has_close_elements(numbers: List[float], threshold: float) -> bool:\n for idx, elem in enumerate(numbers):\n for idx2, elem2 in enumerate(numbers):\n if idx != idx2:\n distance = elem - elem2\n if distance < threshold:\n return True\n\n return FalseFix bugs in has_close_elements."

Feel free to share your generations in the Community tab!

Generation
# pip install -q transformers
from transformers import AutoModelForCausalLM, AutoTokenizer
checkpoint = "bigcode/santacoderpack"
device = "cuda" # for GPU usage or "cpu" for CPU usage
tokenizer = AutoTokenizer.from_pretrained(checkpoint)
model = AutoModelForCausalLM.from_pretrained(checkpoint).to(device)
inputs = tokenizer.encode("Q<commit_before>def has_close_elements(numbers: List[float], threshold: float) -> bool:\n    for idx, elem in enumerate(numbers):\n        for idx2, elem2 in enumerate(numbers):\n            if idx != idx2:\n                distance = elem - elem2\n                if distance < threshold:\n                    return True\n\n    return False<commit_message>Fix bugs in has_close_elements.<commit_after>", return_tensors="pt").to(device)
outputs = model.generate(inputs)
print(tokenizer.decode(outputs[0]))

Training

Model
  • Architecture: GPT-2 model with multi-query attention
  • Steps: 250k pretraining
  • Pretraining tokens: 131B
  • Precision: bfloat16
Hardware
  • Pretraining:
    • GPUs: 32 Tesla A100
    • Training time: 15 days
Software

Citation

@article{muennighoff2023octopack,
      title={OctoPack: Instruction Tuning Code Large Language Models}, 
      author={Niklas Muennighoff and Qian Liu and Armel Zebaze and Qinkai Zheng and Binyuan Hui and Terry Yue Zhuo and Swayam Singh and Xiangru Tang and Leandro von Werra and Shayne Longpre},
      journal={arXiv preprint arXiv:2308.07124},
      year={2023}
}

Runs of bigcode santacoderpack on huggingface.co

175
Total runs
0
24-hour runs
-1
3-day runs
-32
7-day runs
0
30-day runs

More Information About santacoderpack huggingface.co Model

More santacoderpack license Visit here:

https://choosealicense.com/licenses/bigcode-openrail-m

santacoderpack huggingface.co

santacoderpack huggingface.co is an AI model on huggingface.co that provides santacoderpack's model effect (), which can be used instantly with this bigcode santacoderpack model. huggingface.co supports a free trial of the santacoderpack model, and also provides paid use of the santacoderpack. Support call santacoderpack model through api, including Node.js, Python, http.

santacoderpack huggingface.co Url

https://huggingface.co/bigcode/santacoderpack

bigcode santacoderpack online free

santacoderpack huggingface.co is an online trial and call api platform, which integrates santacoderpack's modeling effects, including api services, and provides a free online trial of santacoderpack, you can try santacoderpack online for free by clicking the link below.

bigcode santacoderpack online free url in huggingface.co:

https://huggingface.co/bigcode/santacoderpack

santacoderpack install

santacoderpack is an open source model from GitHub that offers a free installation service, and any user can find santacoderpack on GitHub to install. At the same time, huggingface.co provides the effect of santacoderpack install, users can directly use santacoderpack installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

santacoderpack install url in huggingface.co:

https://huggingface.co/bigcode/santacoderpack

Url of santacoderpack

santacoderpack huggingface.co Url

Provider of santacoderpack huggingface.co

bigcode
ORGANIZATIONS

Other API from bigcode

huggingface.co

Total runs: 1.1M
Run Growth: 717.0K
Growth Rate: 68.17%
Updated: Março 04 2024
huggingface.co

Total runs: 35.3K
Run Growth: 26.7K
Growth Rate: 78.08%
Updated: Junho 11 2024
huggingface.co

Total runs: 18.6K
Run Growth: 1.0K
Growth Rate: 5.67%
Updated: Outubro 08 2024
huggingface.co

Total runs: 7.0K
Run Growth: -48.3K
Growth Rate: -719.62%
Updated: Outubro 12 2023
huggingface.co

Total runs: 2.1K
Run Growth: -472
Growth Rate: -23.95%
Updated: Maio 10 2023
huggingface.co

Total runs: 1.6K
Run Growth: -1.9K
Growth Rate: -128.21%
Updated: Maio 11 2023
huggingface.co

Total runs: 376
Run Growth: -287
Growth Rate: -101.06%
Updated: Julho 24 2023
huggingface.co

Total runs: 286
Run Growth: 93
Growth Rate: 32.52%
Updated: Agosto 17 2023
huggingface.co

Total runs: 159
Run Growth: -16
Growth Rate: -10.06%
Updated: Agosto 17 2023
huggingface.co

Total runs: 25
Run Growth: -145
Growth Rate: -580.00%
Updated: Agosto 13 2023
huggingface.co

Total runs: 19
Run Growth: 15
Growth Rate: 78.95%
Updated: Janeiro 01 2024
huggingface.co

Total runs: 18
Run Growth: 1
Growth Rate: 5.56%
Updated: Agosto 05 2023
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated: Fevereiro 28 2024
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated: Janeiro 14 2025