Total runs:
1.4M
Run Growth:
-288.0K
Growth Rate:
-20.67%
dbmdz / electra-base-turkish-mc4-cased-generator
Model's Last Updated: September 07 2023
fill-mask
Introduction of electra-base-turkish-mc4-cased-generator
Model Details of electra-base-turkish-mc4-cased-generator
🇹🇷 Turkish ELECTRA model
We present community-driven BERT, DistilBERT, ELECTRA and ConvBERT models for Turkish 🎉
Some datasets used for pretraining and evaluation are contributed from the awesome Turkish NLP community, as well as the decision for the BERT model name: BERTurk.
Logo is provided by Merve Noyan .
Stats
We've also trained an ELECTRA (cased) model on the recently released Turkish part of the multiligual C4 (mC4) corpus from the AI2 team.
After filtering documents with a broken encoding, the training corpus has a size of 242GB resulting in 31,240,963,926 tokens.
We used the original 32k vocab (instead of creating a new one).
mC4 ELECTRA
In addition to the ELEC TR A base model, we also trained an ELECTRA model on the Turkish part of the mC4 corpus. We use a sequence length of 512 over the full training time and train the model for 1M steps on a v3-32 TPU.
Model usage
All trained models can be used from the DBMDZ Hugging Face model hub page using their model name.
Example usage with 🤗/Transformers:
tokenizer = AutoTokenizer.from_pretrained("dbmdz/electra-base-turkish-mc4-cased-generator")
model = AutoModel.from_pretrained("dbmdz/electra-base-turkish-mc4-cased-generator")
Citation
You can use the following BibTeX entry for citation:
@software{stefan_schweter_2020_3770924,
author = {Stefan Schweter},
title = {BERTurk - BERT models for Turkish},
month = apr,
year = 2020,
publisher = {Zenodo},
version = {1.0.0},
doi = {10.5281/zenodo.3770924},
url = {https://doi.org/10.5281/zenodo.3770924}
}
Acknowledgments
Thanks to Kemal Oflazer for providing us additional large corpora for Turkish. Many thanks to Reyyan Yeniterzi for providing us the Turkish NER dataset for evaluation.
We would like to thank Merve Noyan for the awesome logo!
Research supported with Cloud TPUs from Google's TensorFlow Research Cloud (TFRC). Thanks for providing access to the TFRC ❤️
Runs of dbmdz electra-base-turkish-mc4-cased-generator on huggingface.co
3
Total runs
0
24-hour runs
0
3-day runs
-45
7-day runs
-53
30-day runs
More Information About electra-base-turkish-mc4-cased-generator huggingface.co Model
Url of electra-base-turkish-mc4-cased-generator
electra-base-turkish-mc4-cased-generator huggingface.co Url
Provider of electra-base-turkish-mc4-cased-generator huggingface.co
Other API from dbmdz
Updated: September 07 2023
Total runs:
86.2K
Run Growth:
-201
Growth Rate:
-0.23%
Total runs:
68.9K
Run Growth:
-16.8K
Growth Rate:
-23.27%
Total runs:
65.9K
Run Growth:
25.4K
Growth Rate:
39.83%
Total runs:
48.1K
Run Growth:
11.5K
Growth Rate:
23.63%
Total runs:
42.5K
Run Growth:
35.0K
Growth Rate:
85.08%
Total runs:
38.3K
Run Growth:
23.0K
Growth Rate:
61.06%
Total runs:
25.6K
Run Growth:
9.3K
Growth Rate:
36.52%
Total runs:
25.0K
Run Growth:
1.9K
Growth Rate:
7.66%
Total runs:
9.3K
Run Growth:
2.2K
Growth Rate:
23.87%
Total runs:
6.7K
Run Growth:
521
Growth Rate:
7.75%
Total runs:
4.6K
Run Growth:
2.0K
Growth Rate:
43.25%
Total runs:
3.7K
Run Growth:
-1.5K
Growth Rate:
-41.94%
Total runs:
1.6K
Run Growth:
26
Growth Rate:
1.67%
Total runs:
1.3K
Run Growth:
774
Growth Rate:
58.77%
Total runs:
1.3K
Run Growth:
-2.4K
Growth Rate:
-190.95%
Total runs:
1000
Run Growth:
-218
Growth Rate:
-21.80%
Total runs:
804
Run Growth:
793
Growth Rate:
98.63%
Total runs:
567
Run Growth:
-219
Growth Rate:
-39.82%
Total runs:
482
Run Growth:
-195
Growth Rate:
-40.46%
Total runs:
455
Run Growth:
263
Growth Rate:
57.80%
Total runs:
287
Run Growth:
221
Growth Rate:
77.00%
Total runs:
286
Run Growth:
23
Growth Rate:
8.04%
Total runs:
264
Run Growth:
189
Growth Rate:
71.59%
Total runs:
231
Run Growth:
-182
Growth Rate:
-78.79%
Total runs:
183
Run Growth:
124
Growth Rate:
67.39%
Total runs:
164
Run Growth:
122
Growth Rate:
74.39%
Total runs:
148
Run Growth:
-190
Growth Rate:
-128.38%
Total runs:
138
Run Growth:
125
Growth Rate:
90.58%
Total runs:
119
Run Growth:
58
Growth Rate:
48.74%
Total runs:
118
Run Growth:
-49
Growth Rate:
-41.53%
Total runs:
117
Run Growth:
92
Growth Rate:
78.63%
Total runs:
109
Run Growth:
63
Growth Rate:
57.80%
Total runs:
105
Run Growth:
93
Growth Rate:
88.57%
Total runs:
88
Run Growth:
55
Growth Rate:
62.50%
Total runs:
77
Run Growth:
6
Growth Rate:
8.33%
Total runs:
46
Run Growth:
20
Growth Rate:
43.48%
Total runs:
29
Run Growth:
21
Growth Rate:
72.41%
Total runs:
27
Run Growth:
10
Growth Rate:
37.04%
Total runs:
27
Run Growth:
-5
Growth Rate:
-18.52%
Total runs:
23
Run Growth:
1
Growth Rate:
4.35%
Total runs:
21
Run Growth:
-1
Growth Rate:
-4.76%
Total runs:
20
Run Growth:
6
Growth Rate:
30.00%
Total runs:
15
Run Growth:
7
Growth Rate:
46.67%
Total runs:
14
Run Growth:
1
Growth Rate:
7.14%
Total runs:
12
Run Growth:
2
Growth Rate:
16.67%
Total runs:
12
Run Growth:
-2
Growth Rate:
-16.67%
Total runs:
5
Run Growth:
-1
Growth Rate:
-20.00%
Total runs:
5
Run Growth:
0
Growth Rate:
0.00%
Total runs:
5
Run Growth:
-12
Growth Rate:
-240.00%
Total runs:
4
Run Growth:
-2
Growth Rate:
-50.00%
Total runs:
2
Run Growth:
-8
Growth Rate:
-400.00%
Total runs:
2
Run Growth:
-6
Growth Rate:
-300.00%
Total runs:
2
Run Growth:
-7
Growth Rate:
-350.00%
Total runs:
2
Run Growth:
-3
Growth Rate:
-150.00%
Total runs:
1
Run Growth:
-5
Growth Rate:
-500.00%
Total runs:
1
Run Growth:
-4
Growth Rate:
-400.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%