Total runs:
1.9M
Run Growth:
213.1K
Growth Rate:
11.06%
deepset / roberta-base-squad2-distilled
Model's Last Updated: September 26 2024
question-answering
Introduction of roberta-base-squad2-distilled
Model Details of roberta-base-squad2-distilled
Overview
Language model:
deepset/roberta-base-squad2-distilled
Language:
English
Training data:
SQuAD 2.0 training set
Eval data:
SQuAD 2.0 dev set
Infrastructure
: 4x V100 GPU
Published
: Dec 8th, 2021
Details
- haystack's distillation feature was used for training. deepset/roberta-large-squad2 was used as the teacher model.
Hyperparameters
batch_size = 80
n_epochs = 4
max_seq_len = 384
learning_rate = 3e-5
lr_schedule = LinearWarmup
embeds_dropout_prob = 0.1
temperature = 1.5
distillation_loss_weight = 0.75
Performance
"exact": 79.8366040596311
"f1": 83.916407079888
Authors
Timo Möller:
[email protected]
Julian Risch:
[email protected]
Malte Pietsch:
[email protected]
Michel Bartels:
[email protected]
About us
deepset is the company behind the open-source NLP framework Haystack which is designed to help you build production ready NLP systems that use: Question answering, summarization, ranking etc.
Some of our other work:
- Distilled roberta-base-squad2 (aka "tinyroberta-squad2")
- German BERT (aka "bert-base-german-cased")
- GermanQuAD and GermanDPR datasets and models (aka "gelectra-base-germanquad", "gbert-base-germandpr")
Get in touch and join the Haystack community
For more info on Haystack, visit our GitHub repo and Documentation .
We also have a Discord community open to everyone!
Twitter | LinkedIn | Discord | GitHub Discussions | Website
By the way: we're hiring!
Runs of deepset roberta-base-squad2-distilled on huggingface.co
13.4K
Total runs
0
24-hour runs
-136
3-day runs
-139.2K
7-day runs
-1.3M
30-day runs
More Information About roberta-base-squad2-distilled huggingface.co Model
Url of roberta-base-squad2-distilled
roberta-base-squad2-distilled huggingface.co Url
Provider of roberta-base-squad2-distilled huggingface.co
Other API from deepset
Updated: September 24 2024
Total runs:
223.7K
Run Growth:
16.9K
Growth Rate:
7.56%
Total runs:
102.4K
Run Growth:
19.7K
Growth Rate:
19.22%
Total runs:
51.6K
Run Growth:
38.1K
Growth Rate:
73.84%
Total runs:
39.7K
Run Growth:
28.0K
Growth Rate:
72.93%
Total runs:
36.3K
Run Growth:
8.2K
Growth Rate:
23.21%
Total runs:
31.9K
Run Growth:
-69.4K
Growth Rate:
-225.32%
Total runs:
27.8K
Run Growth:
3.6K
Growth Rate:
13.10%
Total runs:
10.3K
Run Growth:
4.7K
Growth Rate:
47.20%
Total runs:
10.3K
Run Growth:
817
Growth Rate:
8.48%
Total runs:
9.1K
Run Growth:
5.1K
Growth Rate:
66.33%
Total runs:
5.7K
Run Growth:
209
Growth Rate:
3.73%
Total runs:
3.8K
Run Growth:
2.1K
Growth Rate:
54.46%
Total runs:
3.3K
Run Growth:
-646
Growth Rate:
-19.67%
Total runs:
1.9K
Run Growth:
468
Growth Rate:
24.11%
Total runs:
1.1K
Run Growth:
394
Growth Rate:
35.75%
Total runs:
1.0K
Run Growth:
240
Growth Rate:
23.37%
Total runs:
768
Run Growth:
-501
Growth Rate:
-65.23%
Total runs:
704
Run Growth:
-1.3K
Growth Rate:
-190.34%
Total runs:
530
Run Growth:
137
Growth Rate:
25.85%
Total runs:
529
Run Growth:
504
Growth Rate:
95.27%
Total runs:
460
Run Growth:
-358
Growth Rate:
-89.05%
Total runs:
452
Run Growth:
240
Growth Rate:
53.81%
Total runs:
298
Run Growth:
266
Growth Rate:
89.26%
Total runs:
270
Run Growth:
-83
Growth Rate:
-32.17%
Total runs:
244
Run Growth:
168
Growth Rate:
68.85%
Total runs:
224
Run Growth:
106
Growth Rate:
44.17%
Total runs:
207
Run Growth:
-11
Growth Rate:
-5.31%
Total runs:
198
Run Growth:
141
Growth Rate:
81.50%
Total runs:
161
Run Growth:
-39
Growth Rate:
-24.38%
Total runs:
161
Run Growth:
129
Growth Rate:
85.43%
Total runs:
145
Run Growth:
116
Growth Rate:
80.00%
Total runs:
138
Run Growth:
119
Growth Rate:
86.23%
Total runs:
128
Run Growth:
96
Growth Rate:
75.00%
Total runs:
111
Run Growth:
102
Growth Rate:
91.89%
Total runs:
105
Run Growth:
60
Growth Rate:
57.14%
Total runs:
103
Run Growth:
40
Growth Rate:
50.63%
Total runs:
102
Run Growth:
32
Growth Rate:
31.37%
Total runs:
102
Run Growth:
73
Growth Rate:
92.41%
Total runs:
64
Run Growth:
37
Growth Rate:
57.81%
Total runs:
60
Run Growth:
-50
Growth Rate:
-83.33%
Total runs:
58
Run Growth:
40
Growth Rate:
68.97%
Total runs:
28
Run Growth:
8
Growth Rate:
29.63%
Total runs:
20
Run Growth:
-170
Growth Rate:
-850.00%