title: Fine Tuning Bert on Medical Dataset
body: <p>I would like to use a language model such as Bert to get a feature vector for a certain text describing a medical condition.</p>
  <p>As there are many words in the text unknown to most pre-trained models and tokenizers, I wonder which steps are required to achieve this task?</p>
  <p>Using a pre-trained model seems beneficial to me since the dataset describing the medical conditions is quite small.</p>