allenai / biomed_roberta_base

huggingface.co
Total runs: 49.7K
24-hour runs: 0
7-day runs: -689
30-day runs: -640
Model's Last Updated: October 03 2022

Introduction of biomed_roberta_base

Model Details of biomed_roberta_base

BioMed-RoBERTa-base

BioMed-RoBERTa-base is a language model based on the RoBERTa-base (Liu et. al, 2019) architecture. We adapt RoBERTa-base to 2.68 million scientific papers from the Semantic Scholar corpus via continued pretraining. This amounts to 7.55B tokens and 47GB of data. We use the full text of the papers in training, not just abstracts.

Specific details of the adaptive pretraining procedure can be found in Gururangan et. al, 2020.

Evaluation

BioMed-RoBERTa achieves competitive performance to state of the art models on a number of NLP tasks in the biomedical domain (numbers are mean (standard deviation) over 3+ random seeds)

Task Task Type RoBERTa-base BioMed-RoBERTa-base
RCT-180K Text Classification 86.4 (0.3) 86.9 (0.2)
ChemProt Relation Extraction 81.1 (1.1) 83.0 (0.7)
JNLPBA NER 74.3 (0.2) 75.2 (0.1)
BC5CDR NER 85.6 (0.1) 87.8 (0.1)
NCBI-Disease NER 86.6 (0.3) 87.1 (0.8)

More evaluations TBD.

Citation

If using this model, please cite the following paper:

@inproceedings{domains,
 author = {Suchin Gururangan and Ana Marasović and Swabha Swayamdipta and Kyle Lo and Iz Beltagy and Doug Downey and Noah A. Smith},
 title = {Don't Stop Pretraining: Adapt Language Models to Domains and Tasks},
 year = {2020},
 booktitle = {Proceedings of ACL},
}

Runs of allenai biomed_roberta_base on huggingface.co

49.7K
Total runs
0
24-hour runs
-516
3-day runs
-689
7-day runs
-640
30-day runs

More Information About biomed_roberta_base huggingface.co Model

biomed_roberta_base huggingface.co

biomed_roberta_base huggingface.co is an AI model on huggingface.co that provides biomed_roberta_base's model effect (), which can be used instantly with this allenai biomed_roberta_base model. huggingface.co supports a free trial of the biomed_roberta_base model, and also provides paid use of the biomed_roberta_base. Support call biomed_roberta_base model through api, including Node.js, Python, http.

biomed_roberta_base huggingface.co Url

https://huggingface.co/allenai/biomed_roberta_base

allenai biomed_roberta_base online free

biomed_roberta_base huggingface.co is an online trial and call api platform, which integrates biomed_roberta_base's modeling effects, including api services, and provides a free online trial of biomed_roberta_base, you can try biomed_roberta_base online for free by clicking the link below.

allenai biomed_roberta_base online free url in huggingface.co:

https://huggingface.co/allenai/biomed_roberta_base

biomed_roberta_base install

biomed_roberta_base is an open source model from GitHub that offers a free installation service, and any user can find biomed_roberta_base on GitHub to install. At the same time, huggingface.co provides the effect of biomed_roberta_base install, users can directly use biomed_roberta_base installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

biomed_roberta_base install url in huggingface.co:

https://huggingface.co/allenai/biomed_roberta_base

Url of biomed_roberta_base

biomed_roberta_base huggingface.co Url

Provider of biomed_roberta_base huggingface.co

allenai
ORGANIZATIONS

Other API from allenai

huggingface.co

Total runs: 91.7K
Run Growth: 78.6K
Growth Rate: 85.70%
Updated: October 18 2023
huggingface.co

Total runs: 91.3K
Run Growth: 63.3K
Growth Rate: 69.57%
Updated: January 06 2025
huggingface.co

Total runs: 77.3K
Run Growth: -517.1K
Growth Rate: -669.13%
Updated: October 10 2024
huggingface.co

Total runs: 63.3K
Run Growth: 51.7K
Growth Rate: 81.63%
Updated: October 10 2024
huggingface.co

Total runs: 61.6K
Run Growth: -50.5K
Growth Rate: -81.96%
Updated: December 04 2024
huggingface.co

Total runs: 23.0K
Run Growth: 7.7K
Growth Rate: 33.79%
Updated: August 14 2024
huggingface.co

Total runs: 8.5K
Run Growth: 3.3K
Growth Rate: 36.78%
Updated: July 16 2024
huggingface.co

Total runs: 6.1K
Run Growth: -21.5K
Growth Rate: -354.06%
Updated: July 03 2024
huggingface.co

Total runs: 5.1K
Run Growth: -17.0K
Growth Rate: -321.48%
Updated: July 16 2024
huggingface.co

Total runs: 2.5K
Run Growth: -163
Growth Rate: -6.49%
Updated: December 04 2024
huggingface.co

Total runs: 1.7K
Run Growth: -110
Growth Rate: -6.43%
Updated: July 16 2024
huggingface.co

Total runs: 895
Run Growth: 878
Growth Rate: 98.10%
Updated: January 24 2023
huggingface.co

Total runs: 502
Run Growth: -100
Growth Rate: -21.23%
Updated: January 24 2023
huggingface.co

Total runs: 486
Run Growth: 256
Growth Rate: 52.67%
Updated: February 12 2024
huggingface.co

Total runs: 404
Run Growth: 354
Growth Rate: 94.65%
Updated: June 13 2024
huggingface.co

Total runs: 313
Run Growth: -437
Growth Rate: -139.62%
Updated: April 30 2024
huggingface.co

Total runs: 297
Run Growth: 159
Growth Rate: 53.54%
Updated: April 19 2024