FremyCompany
commited on
Commit
·
97e127f
1
Parent(s):
fb239a7
Add link to BioLORD-2023
Browse files
README.md
CHANGED
@@ -21,12 +21,16 @@ widget:
|
|
21 |
# FremyCompany/BioLORD-STAMB2-v1
|
22 |
This model was trained using BioLORD, a new pre-training strategy for producing meaningful representations for clinical sentences and biomedical concepts.
|
23 |
|
|
|
|
|
|
|
|
|
|
|
24 |
State-of-the-art methodologies operate by maximizing the similarity in representation of names referring to the same concept, and preventing collapse through contrastive learning. However, because biomedical names are not always self-explanatory, it sometimes results in non-semantic representations.
|
25 |
|
26 |
BioLORD overcomes this issue by grounding its concept representations using definitions, as well as short descriptions derived from a multi-relational knowledge graph consisting of biomedical ontologies. Thanks to this grounding, our model produces more semantic concept representations that match more closely the hierarchical structure of ontologies. BioLORD establishes a new state of the art for text similarity on both clinical sentences (MedSTS) and biomedical concepts (MayoSRS).
|
27 |
|
28 |
This model is based on [sentence-transformers/all-mpnet-base-v2](https://huggingface.co/sentence-transformers/all-mpnet-base-v2) and was further finetuned on the [BioLORD-Dataset](https://huggingface.co/datasets/FremyCompany/BioLORD-Dataset).
|
29 |
-
<img width="640" src="https://s3.amazonaws.com/moonup/production/uploads/1665568401241-5f04e8865d08220171a0ad3f.png" />
|
30 |
|
31 |
|
32 |
## General purpose
|
|
|
21 |
# FremyCompany/BioLORD-STAMB2-v1
|
22 |
This model was trained using BioLORD, a new pre-training strategy for producing meaningful representations for clinical sentences and biomedical concepts.
|
23 |
|
24 |
+
> ## IMPORTANT NOTE:
|
25 |
+
> **This model was introduced in 2022. Since then, a new version has been published.** <br>
|
26 |
+
> For most use cases, you will be better served by [BioLORD-2023](https://huggingface.co/FremyCompany/BioLORD-2023), our latest generation of BioLORD models.
|
27 |
+
|
28 |
+
|
29 |
State-of-the-art methodologies operate by maximizing the similarity in representation of names referring to the same concept, and preventing collapse through contrastive learning. However, because biomedical names are not always self-explanatory, it sometimes results in non-semantic representations.
|
30 |
|
31 |
BioLORD overcomes this issue by grounding its concept representations using definitions, as well as short descriptions derived from a multi-relational knowledge graph consisting of biomedical ontologies. Thanks to this grounding, our model produces more semantic concept representations that match more closely the hierarchical structure of ontologies. BioLORD establishes a new state of the art for text similarity on both clinical sentences (MedSTS) and biomedical concepts (MayoSRS).
|
32 |
|
33 |
This model is based on [sentence-transformers/all-mpnet-base-v2](https://huggingface.co/sentence-transformers/all-mpnet-base-v2) and was further finetuned on the [BioLORD-Dataset](https://huggingface.co/datasets/FremyCompany/BioLORD-Dataset).
|
|
|
34 |
|
35 |
|
36 |
## General purpose
|