Deep Learning, Artificial Intelligence, Medical, NLP, Llm.
abstracts and clinical notes, respectively. Overall, the proposed BERT-Base (P+M) that were pretrained on both PubMed abstract and MIMIC-III achieved the best results across five tasks BERT-Large pre-trained on PubMed and MIMIC is worse than other models overall. This is partially because the