Language model for Tuvan. Model has 1.3B parameters as you can guess from it's name.
Tuvan belongs to Turkic language family. It's a very evocative language with approximately 0.3 million speakers. Here are some facts about it:
Spoken in the Tuva Republic in Russia, located in southern Siberia.
It is famous for its throat singing or khoomei tradition.
The Tuvan language has been influenced by Mongolic languages, reflecting the historical ties between the Tuvans and Mongols.
Technical details
It's one of the models derived from the base
mGPT-XL (1.3B)
model (see the list below) which was originally trained on the 61 languages from 25 language families using Wikipedia and C4 corpus.
We've found additional data for 23 languages most of which are considered as minor and decided to further tune the base model.
Tuvan mGPT 1.3B
was trained for another 2000 steps with batch_size=4 and context window of
2048
tokens on 1 A100.
Final perplexity for this model on validation is
40.84
.
mGPT-1.3B-tuvan huggingface.co is an AI model on huggingface.co that provides mGPT-1.3B-tuvan's model effect (), which can be used instantly with this ai-forever mGPT-1.3B-tuvan model. huggingface.co supports a free trial of the mGPT-1.3B-tuvan model, and also provides paid use of the mGPT-1.3B-tuvan. Support call mGPT-1.3B-tuvan model through api, including Node.js, Python, http.
mGPT-1.3B-tuvan huggingface.co is an online trial and call api platform, which integrates mGPT-1.3B-tuvan's modeling effects, including api services, and provides a free online trial of mGPT-1.3B-tuvan, you can try mGPT-1.3B-tuvan online for free by clicking the link below.
ai-forever mGPT-1.3B-tuvan online free url in huggingface.co:
mGPT-1.3B-tuvan is an open source model from GitHub that offers a free installation service, and any user can find mGPT-1.3B-tuvan on GitHub to install. At the same time, huggingface.co provides the effect of mGPT-1.3B-tuvan install, users can directly use mGPT-1.3B-tuvan installed effect in huggingface.co for debugging and trial. It also supports api for free installation.