Total runs:
1.9M
Run Growth:
92.1K
Growth Rate:
4.84%
deepset / gelectra-base-germanquad
Model's Last Updated: September 26 2024
question-answering
Introduction of gelectra-base-germanquad
Model Details of gelectra-base-germanquad
Overview
Language model:
gelectra-base-germanquad
Language:
German
Training data:
GermanQuAD train set (~ 12MB)
Eval data:
GermanQuAD test set (~ 5MB)
Infrastructure
: 1x V100 GPU
Published
: Apr 21st, 2021
Details
- We trained a German question answering model with a gelectra-base model as its basis.
- The dataset is GermanQuAD, a new, German language dataset, which we hand-annotated and published online .
- The training dataset is one-way annotated and contains 11518 questions and 11518 answers, while the test dataset is three-way annotated so that there are 2204 questions and with 2204·3−76 = 6536answers, because we removed 76 wrong answers.
See https://deepset.ai/germanquad for more details and dataset download in SQuAD format.
Hyperparameters
batch_size = 24
n_epochs = 2
max_seq_len = 384
learning_rate = 3e-5
lr_schedule = LinearWarmup
embeds_dropout_prob = 0.1
Performance
We evaluated the extractive question answering performance on our GermanQuAD test set.
Model types and training data are included in the model name.
For finetuning XLM-Roberta, we use the English SQuAD v2.0 dataset.
The GELECTRA models are warm started on the German translation of SQuAD v1.1 and finetuned on
GermanQuAD
.
The human baseline was computed for the 3-way test set by taking one answer as prediction and the other two as ground truth.
Authors
Timo Möller:
[email protected]
Julian Risch:
[email protected]
Malte Pietsch:
[email protected]
About us
deepset is the company behind the open-source NLP framework Haystack which is designed to help you build production ready NLP systems that use: Question answering, summarization, ranking etc.
Some of our other work:
- Distilled roberta-base-squad2 (aka "tinyroberta-squad2")
- German BERT (aka "bert-base-german-cased")
- GermanQuAD and GermanDPR datasets and models (aka "gelectra-base-germanquad", "gbert-base-germandpr")
Get in touch and join the Haystack community
For more info on Haystack, visit our GitHub repo and Documentation .
We also have a Discord community open to everyone!
Twitter | LinkedIn | Discord | GitHub Discussions | Website
By the way: we're hiring!
Runs of deepset gelectra-base-germanquad on huggingface.co
877
Total runs
28
24-hour runs
95
3-day runs
298
7-day runs
-464
30-day runs
More Information About gelectra-base-germanquad huggingface.co Model
Url of gelectra-base-germanquad
gelectra-base-germanquad huggingface.co Url
Provider of gelectra-base-germanquad huggingface.co
Other API from deepset
Updated: September 24 2024
Total runs:
222.5K
Run Growth:
10.7K
Growth Rate:
4.79%
Total runs:
152.1K
Run Growth:
-1.2M
Growth Rate:
-599.53%
Total runs:
96.0K
Run Growth:
9.5K
Growth Rate:
10.13%
Total runs:
46.7K
Run Growth:
31.3K
Growth Rate:
70.34%
Total runs:
31.1K
Run Growth:
16.8K
Growth Rate:
56.89%
Total runs:
30.5K
Run Growth:
-115
Growth Rate:
-0.39%
Total runs:
27.4K
Run Growth:
-75.6K
Growth Rate:
-279.51%
Total runs:
27.4K
Run Growth:
5.1K
Growth Rate:
18.56%
Total runs:
9.3K
Run Growth:
3.4K
Growth Rate:
37.13%
Total runs:
7.8K
Run Growth:
-3.0K
Growth Rate:
-38.84%
Total runs:
5.3K
Run Growth:
1.6K
Growth Rate:
30.19%
Total runs:
5.1K
Run Growth:
-383
Growth Rate:
-7.36%
Total runs:
3.6K
Run Growth:
1.9K
Growth Rate:
51.72%
Total runs:
3.2K
Run Growth:
-2.6K
Growth Rate:
-81.61%
Total runs:
2.0K
Run Growth:
630
Growth Rate:
32.68%
Total runs:
840
Run Growth:
-140
Growth Rate:
-16.63%
Total runs:
590
Run Growth:
-1.5K
Growth Rate:
-259.86%
Total runs:
431
Run Growth:
395
Growth Rate:
91.65%
Total runs:
430
Run Growth:
-336
Growth Rate:
-74.50%
Total runs:
367
Run Growth:
-1.6K
Growth Rate:
-468.33%
Total runs:
309
Run Growth:
-150
Growth Rate:
-54.35%
Total runs:
243
Run Growth:
122
Growth Rate:
51.26%
Total runs:
190
Run Growth:
28
Growth Rate:
14.74%
Total runs:
173
Run Growth:
100
Growth Rate:
61.73%
Total runs:
150
Run Growth:
-2
Growth Rate:
-1.29%
Total runs:
146
Run Growth:
-204
Growth Rate:
-136.91%
Total runs:
135
Run Growth:
118
Growth Rate:
88.06%
Total runs:
133
Run Growth:
102
Growth Rate:
76.69%
Total runs:
121
Run Growth:
48
Growth Rate:
39.67%
Total runs:
112
Run Growth:
-1
Growth Rate:
-0.88%
Total runs:
65
Run Growth:
33
Growth Rate:
50.77%
Total runs:
58
Run Growth:
-103
Growth Rate:
-177.59%
Total runs:
56
Run Growth:
22
Growth Rate:
39.29%
Total runs:
48
Run Growth:
18
Growth Rate:
52.94%
Total runs:
32
Run Growth:
14
Growth Rate:
43.75%
Total runs:
21
Run Growth:
-100
Growth Rate:
-476.19%
Total runs:
21
Run Growth:
-53
Growth Rate:
-265.00%
Total runs:
21
Run Growth:
-91
Growth Rate:
-433.33%
Total runs:
19
Run Growth:
5
Growth Rate:
26.32%
Total runs:
19
Run Growth:
-55
Growth Rate:
-289.47%
Total runs:
18
Run Growth:
-13
Growth Rate:
-76.47%
Total runs:
5
Run Growth:
-188
Growth Rate:
-3760.00%