Total runs:
20.3K
Run Growth:
-1.2K
Growth Rate:
-5.92%
castorini / aggretriever-distilbert
Model's Last Updated: April 07 2023
Introduction of aggretriever-distilbert
Model Details of aggretriever-distilbert
Aggretriever is an encoder to aggregate both lexical and semantic text information into a single-vector dense vector for dense retrieval, which is finetued on MS MARCO corpus with BM25 negative sampling, following the approach described in Aggretriever: A Simple Approach to Aggregate Textual Representation for Robust Dense Passage Retrieval .
The associated GitHub repository for fine-tuning is available here and the reproduce from pyserini is [here]. The following variants are also available:
| Model | Initialization | MARCO Dev | Encoder Path |
|---|---|---|---|
| aggretriever-distilbert | distilbert-base-uncased | 34.1 | castorini/aggretriever-distilbert |
| aggretriever-cocondenser | Luyu/co-condenser-marco | 36.2 | castorini/aggretriever-cocondenser |
Usage (HuggingFace Transformers)
Using the model directly available in HuggingFace transformers. We use the implemented Aggretriever from pyserini here .
from pyserini.encode._aggretriever import AggretrieverQueryEncoder
from pyserini.encode._aggretriever import AggretrieverDocumentEncoder
model_name = '/store/scratch/s269lin/experiments/aggretriever/hf_model/aggretriever-distilbert'
query_encoder = AggretrieverQueryEncoder(model_name, device='cpu')
context_encoder = AggretrieverDocumentEncoder(model_name, device='cpu')
query = "Where was Marie Curie born?"
contexts = [
"Maria Sklodowska, later known as Marie Curie, was born on November 7, 1867.",
"Born in Paris on 15 May 1859, Pierre Curie was the son of Eugène Curie, a doctor of French Catholic origin from Alsace."
]
# Compute embeddings
query_emb = query_encoder.encode(query)
ctx_emb = context_encoder.encode(contexts)
# Compute similarity scores using dot product
score1 = query_emb @ ctx_emb[0] # 47.667152
score2 = query_emb @ ctx_emb[1] # 39.054127
Runs of castorini aggretriever-distilbert on huggingface.co
12
Total runs
0
24-hour runs
-4
3-day runs
-21
7-day runs
-72
30-day runs
More Information About aggretriever-distilbert huggingface.co Model
Url of aggretriever-distilbert
aggretriever-distilbert huggingface.co Url
Provider of aggretriever-distilbert huggingface.co
Other API from castorini
Updated: November 24 2021
Total runs:
7.2K
Run Growth:
5.7K
Growth Rate:
79.04%
Total runs:
2.8K
Run Growth:
-10.5K
Growth Rate:
-374.39%
Total runs:
2.8K
Run Growth:
-3.5K
Growth Rate:
-119.76%
Total runs:
2.5K
Run Growth:
-620
Growth Rate:
-25.07%
Total runs:
2.0K
Run Growth:
425
Growth Rate:
21.28%
Total runs:
1.9K
Run Growth:
-282
Growth Rate:
-15.19%
Total runs:
1.4K
Run Growth:
-43
Growth Rate:
-3.06%
Total runs:
1.2K
Run Growth:
317
Growth Rate:
26.53%
Total runs:
741
Run Growth:
628
Growth Rate:
84.41%
Total runs:
739
Run Growth:
212
Growth Rate:
29.65%
Total runs:
670
Run Growth:
92
Growth Rate:
13.73%
Total runs:
528
Run Growth:
268
Growth Rate:
50.66%
Total runs:
498
Run Growth:
347
Growth Rate:
69.40%
Total runs:
477
Run Growth:
339
Growth Rate:
71.07%
Total runs:
441
Run Growth:
-22
Growth Rate:
-4.99%
Total runs:
437
Run Growth:
-794
Growth Rate:
-200.51%
Total runs:
422
Run Growth:
403
Growth Rate:
95.50%
Total runs:
285
Run Growth:
-192
Growth Rate:
-66.90%
Total runs:
264
Run Growth:
-171
Growth Rate:
-66.28%
Total runs:
262
Run Growth:
-174
Growth Rate:
-67.97%
Total runs:
257
Run Growth:
247
Growth Rate:
96.48%
Total runs:
235
Run Growth:
-6.4K
Growth Rate:
-2685.36%
Total runs:
233
Run Growth:
217
Growth Rate:
97.31%
Total runs:
211
Run Growth:
98
Growth Rate:
46.45%
Total runs:
178
Run Growth:
154
Growth Rate:
86.52%
Total runs:
168
Run Growth:
26
Growth Rate:
15.48%
Total runs:
166
Run Growth:
-15
Growth Rate:
-8.93%
Total runs:
164
Run Growth:
82
Growth Rate:
49.40%
Total runs:
161
Run Growth:
154
Growth Rate:
93.90%
Total runs:
159
Run Growth:
113
Growth Rate:
71.07%
Total runs:
155
Run Growth:
125
Growth Rate:
80.65%
Total runs:
142
Run Growth:
115
Growth Rate:
77.70%
Total runs:
137
Run Growth:
112
Growth Rate:
81.75%
Total runs:
137
Run Growth:
-407
Growth Rate:
-297.08%
Total runs:
126
Run Growth:
-78
Growth Rate:
-60.94%
Total runs:
124
Run Growth:
108
Growth Rate:
86.40%
Total runs:
123
Run Growth:
95
Growth Rate:
77.24%
Total runs:
119
Run Growth:
-183
Growth Rate:
-151.24%
Total runs:
118
Run Growth:
62
Growth Rate:
51.67%
Total runs:
117
Run Growth:
118
Growth Rate:
99.16%
Total runs:
114
Run Growth:
114
Growth Rate:
97.44%
Total runs:
111
Run Growth:
111
Growth Rate:
98.23%
Total runs:
108
Run Growth:
44
Growth Rate:
40.00%
Total runs:
108
Run Growth:
73
Growth Rate:
66.36%
Total runs:
107
Run Growth:
99
Growth Rate:
92.52%
Total runs:
101
Run Growth:
80
Growth Rate:
76.92%
Total runs:
97
Run Growth:
93
Growth Rate:
95.88%
Total runs:
95
Run Growth:
-108
Growth Rate:
-111.34%
Total runs:
88
Run Growth:
77
Growth Rate:
87.50%
Total runs:
86
Run Growth:
-64
Growth Rate:
-59.81%
Total runs:
41
Run Growth:
37
Growth Rate:
90.24%
Total runs:
41
Run Growth:
-69
Growth Rate:
-168.29%
Total runs:
40
Run Growth:
27
Growth Rate:
67.50%
Total runs:
39
Run Growth:
8
Growth Rate:
20.51%
Total runs:
37
Run Growth:
5
Growth Rate:
13.51%
Total runs:
37
Run Growth:
6
Growth Rate:
16.22%
Total runs:
37
Run Growth:
5
Growth Rate:
13.51%
Total runs:
37
Run Growth:
31
Growth Rate:
83.78%
Total runs:
37
Run Growth:
6
Growth Rate:
16.22%
Total runs:
37
Run Growth:
6
Growth Rate:
16.22%
Total runs:
36
Run Growth:
8
Growth Rate:
22.22%
Total runs:
35
Run Growth:
-265
Growth Rate:
-757.14%
Total runs:
29
Run Growth:
-3
Growth Rate:
-10.34%
Total runs:
29
Run Growth:
26
Growth Rate:
89.66%
Total runs:
29
Run Growth:
18
Growth Rate:
62.07%
Total runs:
28
Run Growth:
21
Growth Rate:
75.00%
Total runs:
24
Run Growth:
-93
Growth Rate:
-387.50%
Total runs:
22
Run Growth:
23
Growth Rate:
92.00%
Total runs:
22
Run Growth:
15
Growth Rate:
65.22%
Total runs:
21
Run Growth:
-85
Growth Rate:
-404.76%
Total runs:
20
Run Growth:
13
Growth Rate:
65.00%
Total runs:
20
Run Growth:
-120
Growth Rate:
-600.00%
Total runs:
20
Run Growth:
-66
Growth Rate:
-330.00%
Total runs:
19
Run Growth:
-120
Growth Rate:
-631.58%
Total runs:
18
Run Growth:
-89
Growth Rate:
-494.44%
Total runs:
18
Run Growth:
-93
Growth Rate:
-516.67%
Total runs:
16
Run Growth:
-92
Growth Rate:
-575.00%
Total runs:
16
Run Growth:
11
Growth Rate:
68.75%
Total runs:
15
Run Growth:
-2
Growth Rate:
-13.33%
Total runs:
14
Run Growth:
-94
Growth Rate:
-671.43%
Total runs:
14
Run Growth:
-95
Growth Rate:
-678.57%
Total runs:
13
Run Growth:
-94
Growth Rate:
-723.08%
Total runs:
13
Run Growth:
-92
Growth Rate:
-707.69%
Total runs:
13
Run Growth:
-96
Growth Rate:
-738.46%
Total runs:
13
Run Growth:
-94
Growth Rate:
-723.08%
Total runs:
12
Run Growth:
-98
Growth Rate:
-816.67%
Total runs:
12
Run Growth:
9
Growth Rate:
64.29%
Total runs:
11
Run Growth:
-134
Growth Rate:
-1218.18%