Update README.md
Browse files
README.md
CHANGED
@@ -12,16 +12,15 @@ tags:
|
|
12 |
# rttl-ai/BIOptimus v.0.4
|
13 |
|
14 |
## Model Details
|
15 |
-
**Model Description:** BIOptimus v.0.4 model
|
16 |
-
It is
|
|
|
17 |
|
18 |
-
This model achieves state-of-the-art performance on several biomedical NER datasets from [BLURB](https://microsoft.github.io/BLURB/).
|
19 |
|
20 |
- **Developed by:** rttl-ai
|
21 |
-
- **Model Type:**
|
22 |
- **Language(s):** English
|
23 |
- **License:** Apache-2.0
|
24 |
- **Resources for more information:**
|
25 |
-
-
|
26 |
-
|
27 |
-
- fine-tuned on sst2
|
|
|
12 |
# rttl-ai/BIOptimus v.0.4
|
13 |
|
14 |
## Model Details
|
15 |
+
**Model Description:** BIOptimus v.0.4 model is a BERT-like model pre-trained on [PubMed](https://pubmed.ncbi.nlm.nih.gov/) abstracts.
|
16 |
+
It is a biomedical language model pre-trained using contextualized weight distillation and Curriculum Learning.
|
17 |
+
This model achieves state-of-the-art performance on several biomedical NER datasets from [BLURB benchmark](https://microsoft.github.io/BLURB/).
|
18 |
|
|
|
19 |
|
20 |
- **Developed by:** rttl-ai
|
21 |
+
- **Model Type:** Language model
|
22 |
- **Language(s):** English
|
23 |
- **License:** Apache-2.0
|
24 |
- **Resources for more information:**
|
25 |
+
- It is introduced in the paper BIOptimus: Pre-training an Optimal Biomedical Language Model with Curriculum Learning for Named Entity Recognition (BioNLP workshop @ ACL 2023).
|
26 |
+
- More information is available in [this repository](https://github.com/rttl-ai/BIOptimus).
|
|