ai-forever / rugpt3xl

huggingface.co
Total runs: 0
24-hour runs: 0
7-day runs: 0
30-day runs: 0
Model's Last Updated: September 21 2021

Introduction of rugpt3xl

Model Details of rugpt3xl

rugpt3xl

Model was trained with 512 sequence length using Deepspeed and Megatron code by SberDevices team, on 80B tokens dataset for 4 epochs. After that model was finetuned 1 epoch with sequence length 2048.
Note! Model has sparse attention blocks.

Total training time was around 10 days on 256 GPUs.
Final perplexity on test set is 12.05 . Model parameters: 1.3B.

Runs of ai-forever rugpt3xl on huggingface.co

0
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
0
30-day runs

More Information About rugpt3xl huggingface.co Model

rugpt3xl huggingface.co

rugpt3xl huggingface.co is an AI model on huggingface.co that provides rugpt3xl's model effect (), which can be used instantly with this ai-forever rugpt3xl model. huggingface.co supports a free trial of the rugpt3xl model, and also provides paid use of the rugpt3xl. Support call rugpt3xl model through api, including Node.js, Python, http.

ai-forever rugpt3xl online free

rugpt3xl huggingface.co is an online trial and call api platform, which integrates rugpt3xl's modeling effects, including api services, and provides a free online trial of rugpt3xl, you can try rugpt3xl online for free by clicking the link below.

ai-forever rugpt3xl online free url in huggingface.co:

https://huggingface.co/ai-forever/rugpt3xl

rugpt3xl install

rugpt3xl is an open source model from GitHub that offers a free installation service, and any user can find rugpt3xl on GitHub to install. At the same time, huggingface.co provides the effect of rugpt3xl install, users can directly use rugpt3xl installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

rugpt3xl install url in huggingface.co:

https://huggingface.co/ai-forever/rugpt3xl

Url of rugpt3xl

Provider of rugpt3xl huggingface.co

ai-forever
ORGANIZATIONS

Other API from ai-forever

huggingface.co

Total runs: 525.5K
Run Growth: 507.4K
Growth Rate: 96.56%
Updated: November 03 2023
huggingface.co

Total runs: 10.6K
Run Growth: 1.5K
Growth Rate: 13.75%
Updated: December 05 2023
huggingface.co

Total runs: 8.2K
Run Growth: 5.1K
Growth Rate: 59.45%
Updated: December 29 2024
huggingface.co

Total runs: 5.9K
Run Growth: 3.5K
Growth Rate: 60.26%
Updated: December 11 2023
huggingface.co

Total runs: 2.3K
Run Growth: -408
Growth Rate: -17.86%
Updated: December 05 2023
huggingface.co

Total runs: 1.3K
Run Growth: -6.3K
Growth Rate: -493.39%
Updated: December 05 2023
huggingface.co

Total runs: 315
Run Growth: 165
Growth Rate: 52.05%
Updated: January 26 2023
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated: June 08 2023
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated: December 24 2021