English
Firoj112 commited on
Commit
c400c45
·
verified ·
1 Parent(s): ba14b13

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +39 -3
README.md CHANGED
@@ -1,3 +1,39 @@
1
- ---
2
- license: apache-2.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ datasets:
4
+ - qiaojin/PubMedQA
5
+ language:
6
+ - en
7
+ metrics:
8
+ - accuracy
9
+ base_model:
10
+ - google-bert/bert-base-uncased
11
+ ---
12
+
13
+ # GEM_PubMedQA Model Card
14
+
15
+ This model card provides an overview of the GEM_PubMedQA model, a finetuned implementation of the GEM architecture designed for the PubMedQA dataset.
16
+
17
+ ## Purpose
18
+
19
+ The GEM_PubMedQA model was developed to assess the performance of the GEM architecture on domain-specific datasets, with a focus on healthcare. The PubMedQA dataset, a key benchmark in this field, was selected to evaluate its effectiveness.
20
+
21
+ ## Key Details
22
+
23
+ - **License**: Apache-2.0
24
+ - **Dataset**: qiaojin/PubMedQA
25
+ - **Language**: English
26
+ - **Metrics**: Accuracy: 92.5%
27
+ - **Base Model**: google-bert/bert-base-uncased
28
+
29
+ ## Model Details
30
+
31
+ The GEM_PubMedQA model is built on the GEM architecture and finetuned from the `google-bert/bert-base-uncased` model using the PubMedQA dataset. The training was performed with the following parameters:
32
+
33
+ - **Number of epochs**: 5
34
+ - **Batch size**: 128
35
+ - **Learning rate**: 2e-5
36
+ - **Maximum sequence length**: 128
37
+ - **Gradient accumulation steps**: 2
38
+ - **Cluster size**: 256
39
+ - **Threshold**: 0.65