Deep Learning, Artificial Intelligence, Bert, Ehr, NLP.
2.2. Pretraining G-BERT The model takes the above ontology embedding as input and derive visit embedding vt* for a patient at t-th visit: where [CLS] is a special token as in BERT. It is put in the first position of each visit of type *. One big difference between language sentences and EHR