bigcode / tiny_starcoder_py

huggingface.co
Total runs: 3.2K
24-hour runs: 0
7-day runs: 67
30-day runs: 1.3K
Model's Last Updated: 2023年6月1日
text-generation

Introduction of tiny_starcoder_py

Model Details of tiny_starcoder_py

TinyStarCoderPy

This is a 164M parameters model with the same architecture as StarCoder (8k context length, MQA & FIM). It was trained on the Python data from StarCoderData for ~6 epochs which amounts to 100B tokens.

Use
Intended use

The model was trained on GitHub code, to assist with some tasks like Assisted Generation . For pure code completion, we advise using our 15B models StarCoder or StarCoderBase .

Generation
# pip install -q transformers
from transformers import AutoModelForCausalLM, AutoTokenizer

checkpoint = "bigcode/tiny_starcoder_py"
device = "cuda" # for GPU usage or "cpu" for CPU usage

tokenizer = AutoTokenizer.from_pretrained(checkpoint)
model = AutoModelForCausalLM.from_pretrained(checkpoint).to(device)

inputs = tokenizer.encode("def print_hello_world():", return_tensors="pt").to(device)
outputs = model.generate(inputs)
print(tokenizer.decode(outputs[0]))
Fill-in-the-middle

Fill-in-the-middle uses special tokens to identify the prefix/middle/suffix part of the input and output:

input_text = "<fim_prefix>def print_one_two_three():\n    print('one')\n    <fim_suffix>\n    print('three')<fim_middle>"
inputs = tokenizer.encode(input_text, return_tensors="pt").to(device)
outputs = model.generate(inputs)
print(tokenizer.decode(outputs[0]))

Training

Model
  • Architecture: GPT-2 model with multi-query attention and Fill-in-the-Middle objective
  • Pretraining steps: 50k
  • Pretraining tokens: 100 billion
  • Precision: bfloat16
Hardware
  • GPUs: 32 Tesla A100
  • Training time: 18 hours
Software

License

The model is licensed under the BigCode OpenRAIL-M v1 license agreement. You can find the full agreement here .

Runs of bigcode tiny_starcoder_py on huggingface.co

3.2K
Total runs
0
24-hour runs
44
3-day runs
67
7-day runs
1.3K
30-day runs

More Information About tiny_starcoder_py huggingface.co Model

More tiny_starcoder_py license Visit here:

https://choosealicense.com/licenses/bigcode-openrail-m

tiny_starcoder_py huggingface.co

tiny_starcoder_py huggingface.co is an AI model on huggingface.co that provides tiny_starcoder_py's model effect (), which can be used instantly with this bigcode tiny_starcoder_py model. huggingface.co supports a free trial of the tiny_starcoder_py model, and also provides paid use of the tiny_starcoder_py. Support call tiny_starcoder_py model through api, including Node.js, Python, http.

tiny_starcoder_py huggingface.co Url

https://huggingface.co/bigcode/tiny_starcoder_py

bigcode tiny_starcoder_py online free

tiny_starcoder_py huggingface.co is an online trial and call api platform, which integrates tiny_starcoder_py's modeling effects, including api services, and provides a free online trial of tiny_starcoder_py, you can try tiny_starcoder_py online for free by clicking the link below.

bigcode tiny_starcoder_py online free url in huggingface.co:

https://huggingface.co/bigcode/tiny_starcoder_py

tiny_starcoder_py install

tiny_starcoder_py is an open source model from GitHub that offers a free installation service, and any user can find tiny_starcoder_py on GitHub to install. At the same time, huggingface.co provides the effect of tiny_starcoder_py install, users can directly use tiny_starcoder_py installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

tiny_starcoder_py install url in huggingface.co:

https://huggingface.co/bigcode/tiny_starcoder_py

Url of tiny_starcoder_py

tiny_starcoder_py huggingface.co Url

Provider of tiny_starcoder_py huggingface.co

bigcode
ORGANIZATIONS

Other API from bigcode

huggingface.co

Total runs: 1.1M
Run Growth: 717.0K
Growth Rate: 68.17%
Updated: 2024年3月4日
huggingface.co

Total runs: 35.3K
Run Growth: 26.7K
Growth Rate: 78.08%
Updated: 2024年6月11日
huggingface.co

Total runs: 26.6K
Run Growth: -1.9K
Growth Rate: -7.18%
Updated: 2024年6月5日
huggingface.co

Total runs: 18.6K
Run Growth: 1.0K
Growth Rate: 5.67%
Updated: 2024年10月8日
huggingface.co

Total runs: 7.0K
Run Growth: -48.3K
Growth Rate: -719.62%
Updated: 2023年10月12日
huggingface.co

Total runs: 2.1K
Run Growth: -472
Growth Rate: -23.95%
Updated: 2023年5月10日
huggingface.co

Total runs: 1.6K
Run Growth: -1.9K
Growth Rate: -128.21%
Updated: 2023年5月11日
huggingface.co

Total runs: 376
Run Growth: -287
Growth Rate: -101.06%
Updated: 2023年7月24日
huggingface.co

Total runs: 286
Run Growth: 93
Growth Rate: 32.52%
Updated: 2023年8月17日
huggingface.co

Total runs: 175
Run Growth: -16
Growth Rate: -9.04%
Updated: 2023年8月21日
huggingface.co

Total runs: 159
Run Growth: -16
Growth Rate: -10.06%
Updated: 2023年8月17日
huggingface.co

Total runs: 25
Run Growth: -145
Growth Rate: -580.00%
Updated: 2023年8月13日
huggingface.co

Total runs: 19
Run Growth: 15
Growth Rate: 78.95%
Updated: 2024年1月1日
huggingface.co

Total runs: 18
Run Growth: 1
Growth Rate: 5.56%
Updated: 2023年8月5日
huggingface.co

Total runs: 15
Run Growth: 0
Growth Rate: 0.00%
Updated: 2023年8月5日
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated: 2024年2月28日
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated: 2025年1月14日