Total runs:
20.3K
Run Growth:
-1.2K
Growth Rate:
-5.92%
castorini / azbert-base
Model's Last Updated: 11월 05 2021
fill-mask
Introduction of azbert-base
Model Details of azbert-base
About
Here we share a pretrained BERT model that is aware of math tokens. The math tokens are treated specially and tokenized using pya0 , which adds very limited new tokens for latex markup (total vocabulary is just 31,061).
This model is trained on 4 x 2 Tesla V100 with a total batch size of 64, using Math StackExchange data with 2.7 million sentence pairs trained for 7 epochs.
Usage
Download and try it out
pip install pya0==0.3.2
wget https://vault.cs.uwaterloo.ca/s/gqstFZmWHCLGXe3/download -O ckpt.tar.gz
mkdir -p ckpt
tar xzf ckpt.tar.gz -C ckpt --strip-components=1
python test.py --test_file test.txt
Test file format
Modify the test examples in
test.txt
to play with it.
The test file is tab-separated, the first column is additional positions you want to mask for the right-side sentence (useful for masking tokens in math markups). A zero means no additional mask positions.
Example output
Upload to huggingface
This repo is hosted on Github , and only mirrored at huggingface .
To upload to huggingface, use the
upload2hgf.sh
script.
Before runnig this script, be sure to check:
-
check points for model and tokenizer are created under
./ckptfolder -
model contains all the files needed:
config.jsonandpytorch_model.bin -
tokenizer contains all the files needed:
added_tokens.json,special_tokens_map.json,tokenizer_config.json,vocab.txtandtokenizer.json -
no
tokenizer_filefield intokenizer_config.json(sometimes it is located locally at~/.cache) -
git-lfsis installed -
having git-remote named
hgfreference tohttps://huggingface.co/castorini/azbert-base
Runs of castorini azbert-base on huggingface.co
123
Total runs
2
24-hour runs
6
3-day runs
9
7-day runs
119
30-day runs
More Information About azbert-base huggingface.co Model
Url of azbert-base
azbert-base huggingface.co Url
Provider of azbert-base huggingface.co
Other API from castorini
Updated: 11월 24 2021
Total runs:
7.2K
Run Growth:
5.7K
Growth Rate:
79.04%
Total runs:
2.8K
Run Growth:
-10.5K
Growth Rate:
-374.39%
Total runs:
2.8K
Run Growth:
-3.5K
Growth Rate:
-119.76%
Total runs:
2.5K
Run Growth:
-620
Growth Rate:
-25.07%
Total runs:
2.0K
Run Growth:
425
Growth Rate:
21.28%
Total runs:
1.9K
Run Growth:
-282
Growth Rate:
-15.19%
Total runs:
1.2K
Run Growth:
317
Growth Rate:
26.53%
Total runs:
739
Run Growth:
212
Growth Rate:
29.65%
Total runs:
670
Run Growth:
92
Growth Rate:
13.73%
Total runs:
528
Run Growth:
268
Growth Rate:
50.66%
Total runs:
498
Run Growth:
347
Growth Rate:
69.40%
Total runs:
477
Run Growth:
339
Growth Rate:
71.07%
Total runs:
437
Run Growth:
-794
Growth Rate:
-200.51%
Total runs:
285
Run Growth:
-192
Growth Rate:
-66.90%
Total runs:
264
Run Growth:
-171
Growth Rate:
-66.28%
Total runs:
262
Run Growth:
-174
Growth Rate:
-67.97%
Total runs:
257
Run Growth:
247
Growth Rate:
96.48%
Total runs:
235
Run Growth:
-6.4K
Growth Rate:
-2685.36%
Total runs:
233
Run Growth:
217
Growth Rate:
97.31%
Total runs:
211
Run Growth:
98
Growth Rate:
46.45%
Total runs:
178
Run Growth:
154
Growth Rate:
86.52%
Total runs:
168
Run Growth:
26
Growth Rate:
15.48%
Total runs:
166
Run Growth:
-15
Growth Rate:
-8.93%
Total runs:
164
Run Growth:
82
Growth Rate:
49.40%
Total runs:
161
Run Growth:
154
Growth Rate:
93.90%
Total runs:
155
Run Growth:
125
Growth Rate:
80.65%
Total runs:
142
Run Growth:
115
Growth Rate:
77.70%
Total runs:
137
Run Growth:
-407
Growth Rate:
-297.08%
Total runs:
126
Run Growth:
-78
Growth Rate:
-60.94%
Total runs:
124
Run Growth:
108
Growth Rate:
86.40%
Total runs:
123
Run Growth:
95
Growth Rate:
77.24%
Total runs:
119
Run Growth:
-183
Growth Rate:
-151.24%
Total runs:
118
Run Growth:
62
Growth Rate:
51.67%
Total runs:
117
Run Growth:
118
Growth Rate:
99.16%
Total runs:
114
Run Growth:
114
Growth Rate:
97.44%
Total runs:
111
Run Growth:
111
Growth Rate:
98.23%
Total runs:
108
Run Growth:
44
Growth Rate:
40.00%
Total runs:
108
Run Growth:
73
Growth Rate:
66.36%
Total runs:
107
Run Growth:
99
Growth Rate:
92.52%
Total runs:
101
Run Growth:
80
Growth Rate:
76.92%
Total runs:
97
Run Growth:
93
Growth Rate:
95.88%
Total runs:
95
Run Growth:
-108
Growth Rate:
-111.34%
Total runs:
88
Run Growth:
77
Growth Rate:
87.50%
Total runs:
86
Run Growth:
-64
Growth Rate:
-59.81%
Total runs:
41
Run Growth:
-69
Growth Rate:
-168.29%
Total runs:
40
Run Growth:
27
Growth Rate:
67.50%
Total runs:
39
Run Growth:
8
Growth Rate:
20.51%
Total runs:
37
Run Growth:
5
Growth Rate:
13.51%
Total runs:
37
Run Growth:
6
Growth Rate:
16.22%
Total runs:
37
Run Growth:
5
Growth Rate:
13.51%
Total runs:
37
Run Growth:
31
Growth Rate:
83.78%
Total runs:
37
Run Growth:
6
Growth Rate:
16.22%
Total runs:
37
Run Growth:
6
Growth Rate:
16.22%
Total runs:
36
Run Growth:
8
Growth Rate:
22.22%
Total runs:
35
Run Growth:
-265
Growth Rate:
-757.14%
Total runs:
29
Run Growth:
-3
Growth Rate:
-10.34%
Total runs:
29
Run Growth:
26
Growth Rate:
89.66%
Total runs:
29
Run Growth:
18
Growth Rate:
62.07%
Total runs:
28
Run Growth:
21
Growth Rate:
75.00%
Total runs:
24
Run Growth:
-93
Growth Rate:
-387.50%
Total runs:
22
Run Growth:
23
Growth Rate:
92.00%
Total runs:
22
Run Growth:
15
Growth Rate:
65.22%
Total runs:
21
Run Growth:
-85
Growth Rate:
-404.76%
Total runs:
20
Run Growth:
13
Growth Rate:
65.00%
Total runs:
20
Run Growth:
-120
Growth Rate:
-600.00%
Total runs:
20
Run Growth:
-66
Growth Rate:
-330.00%
Total runs:
19
Run Growth:
-120
Growth Rate:
-631.58%
Total runs:
18
Run Growth:
-89
Growth Rate:
-494.44%
Total runs:
18
Run Growth:
-93
Growth Rate:
-516.67%
Total runs:
16
Run Growth:
-92
Growth Rate:
-575.00%
Total runs:
16
Run Growth:
11
Growth Rate:
68.75%
Total runs:
15
Run Growth:
-2
Growth Rate:
-13.33%
Total runs:
14
Run Growth:
-94
Growth Rate:
-671.43%
Total runs:
14
Run Growth:
-95
Growth Rate:
-678.57%
Total runs:
13
Run Growth:
-94
Growth Rate:
-723.08%
Total runs:
13
Run Growth:
-92
Growth Rate:
-707.69%
Total runs:
13
Run Growth:
-96
Growth Rate:
-738.46%
Total runs:
13
Run Growth:
-94
Growth Rate:
-723.08%
Total runs:
12
Run Growth:
-98
Growth Rate:
-816.67%
Total runs:
12
Run Growth:
-72
Growth Rate:
-600.00%
Total runs:
12
Run Growth:
9
Growth Rate:
64.29%
Total runs:
11
Run Growth:
-134
Growth Rate:
-1218.18%