Total runs:
1.4M
Run Growth:
-288.0K
Growth Rate:
-20.67%
dbmdz / convbert-base-turkish-mc4-cased
Model's Last Updated: September 07 2023
fill-mask
Introduction of convbert-base-turkish-mc4-cased
Model Details of convbert-base-turkish-mc4-cased
🇹🇷 Turkish ConvBERT model
We present community-driven BERT, DistilBERT, ELECTRA and ConvBERT models for Turkish 🎉
Some datasets used for pretraining and evaluation are contributed from the awesome Turkish NLP community, as well as the decision for the BERT model name: BERTurk.
Logo is provided by Merve Noyan .
Stats
We've trained an (cased) ConvBERT model on the recently released Turkish part of the multiligual C4 (mC4) corpus from the AI2 team.
After filtering documents with a broken encoding, the training corpus has a size of 242GB resulting in 31,240,963,926 tokens.
We used the original 32k vocab (instead of creating a new one).
mC4 ConvBERT
In addition to the ELEC TR A base model, we also trained an ConvBERT model on the Turkish part of the mC4 corpus. We use a sequence length of 512 over the full training time and train the model for 1M steps on a v3-32 TPU.
Model usage
All trained models can be used from the DBMDZ Hugging Face model hub page using their model name.
Example usage with 🤗/Transformers:
tokenizer = AutoTokenizer.from_pretrained("dbmdz/convbert-base-turkish-mc4-cased")
model = AutoModel.from_pretrained("dbmdz/convbert-base-turkish-mc4-cased")
Citation
You can use the following BibTeX entry for citation:
@software{stefan_schweter_2020_3770924,
author = {Stefan Schweter},
title = {BERTurk - BERT models for Turkish},
month = apr,
year = 2020,
publisher = {Zenodo},
version = {1.0.0},
doi = {10.5281/zenodo.3770924},
url = {https://doi.org/10.5281/zenodo.3770924}
}
Acknowledgments
Thanks to Kemal Oflazer for providing us additional large corpora for Turkish. Many thanks to Reyyan Yeniterzi for providing us the Turkish NER dataset for evaluation.
We would like to thank Merve Noyan for the awesome logo!
Research supported with Cloud TPUs from Google's TensorFlow Research Cloud (TFRC). Thanks for providing access to the TFRC ❤️
Runs of dbmdz convbert-base-turkish-mc4-cased on huggingface.co
264
Total runs
0
24-hour runs
45
3-day runs
52
7-day runs
189
30-day runs
More Information About convbert-base-turkish-mc4-cased huggingface.co Model
Url of convbert-base-turkish-mc4-cased
convbert-base-turkish-mc4-cased huggingface.co Url
Provider of convbert-base-turkish-mc4-cased huggingface.co
Other API from dbmdz
Updated: September 07 2023
Total runs:
85.7K
Run Growth:
-201
Growth Rate:
-0.23%
Total runs:
72.0K
Run Growth:
-16.8K
Growth Rate:
-23.27%
Total runs:
63.7K
Run Growth:
25.4K
Growth Rate:
39.83%
Total runs:
48.7K
Run Growth:
11.5K
Growth Rate:
23.63%
Total runs:
41.2K
Run Growth:
35.0K
Growth Rate:
85.08%
Total runs:
37.6K
Run Growth:
23.0K
Growth Rate:
61.06%
Total runs:
25.6K
Run Growth:
9.3K
Growth Rate:
36.52%
Total runs:
25.0K
Run Growth:
1.9K
Growth Rate:
7.66%
Total runs:
9.3K
Run Growth:
2.2K
Growth Rate:
23.87%
Total runs:
6.7K
Run Growth:
521
Growth Rate:
7.75%
Total runs:
4.6K
Run Growth:
2.0K
Growth Rate:
43.25%
Total runs:
3.7K
Run Growth:
-1.5K
Growth Rate:
-41.94%
Total runs:
1.6K
Run Growth:
26
Growth Rate:
1.67%
Total runs:
1.3K
Run Growth:
774
Growth Rate:
58.77%
Total runs:
1.3K
Run Growth:
-2.4K
Growth Rate:
-190.95%
Total runs:
1000
Run Growth:
-218
Growth Rate:
-21.80%
Total runs:
804
Run Growth:
793
Growth Rate:
98.63%
Total runs:
550
Run Growth:
-219
Growth Rate:
-39.82%
Total runs:
482
Run Growth:
-195
Growth Rate:
-40.46%
Total runs:
455
Run Growth:
263
Growth Rate:
57.80%
Total runs:
287
Run Growth:
221
Growth Rate:
77.00%
Total runs:
286
Run Growth:
23
Growth Rate:
8.04%
Total runs:
231
Run Growth:
-182
Growth Rate:
-78.79%
Total runs:
184
Run Growth:
124
Growth Rate:
67.39%
Total runs:
164
Run Growth:
122
Growth Rate:
74.39%
Total runs:
148
Run Growth:
-190
Growth Rate:
-128.38%
Total runs:
138
Run Growth:
125
Growth Rate:
90.58%
Total runs:
119
Run Growth:
58
Growth Rate:
48.74%
Total runs:
118
Run Growth:
-49
Growth Rate:
-41.53%
Total runs:
117
Run Growth:
92
Growth Rate:
78.63%
Total runs:
109
Run Growth:
63
Growth Rate:
57.80%
Total runs:
105
Run Growth:
93
Growth Rate:
88.57%
Total runs:
88
Run Growth:
55
Growth Rate:
62.50%
Total runs:
72
Run Growth:
6
Growth Rate:
8.33%
Total runs:
46
Run Growth:
20
Growth Rate:
43.48%
Total runs:
29
Run Growth:
21
Growth Rate:
72.41%
Total runs:
27
Run Growth:
10
Growth Rate:
37.04%
Total runs:
27
Run Growth:
-5
Growth Rate:
-18.52%
Total runs:
23
Run Growth:
1
Growth Rate:
4.35%
Total runs:
21
Run Growth:
-1
Growth Rate:
-4.76%
Total runs:
20
Run Growth:
6
Growth Rate:
30.00%
Total runs:
15
Run Growth:
7
Growth Rate:
46.67%
Total runs:
14
Run Growth:
1
Growth Rate:
7.14%
Total runs:
12
Run Growth:
2
Growth Rate:
16.67%
Total runs:
12
Run Growth:
-2
Growth Rate:
-16.67%
Total runs:
5
Run Growth:
-1
Growth Rate:
-20.00%
Total runs:
5
Run Growth:
0
Growth Rate:
0.00%
Total runs:
5
Run Growth:
-12
Growth Rate:
-240.00%
Total runs:
4
Run Growth:
-2
Growth Rate:
-50.00%
Total runs:
3
Run Growth:
-53
Growth Rate:
-1766.67%
Total runs:
2
Run Growth:
-8
Growth Rate:
-400.00%
Total runs:
2
Run Growth:
-6
Growth Rate:
-300.00%
Total runs:
2
Run Growth:
-7
Growth Rate:
-350.00%
Total runs:
2
Run Growth:
-3
Growth Rate:
-150.00%
Total runs:
1
Run Growth:
-5
Growth Rate:
-500.00%
Total runs:
1
Run Growth:
-4
Growth Rate:
-400.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%