readme: ---
  language:
  - en
  tags:
  - fill-mask
  - roberta
  widget:
  - text: "Polymerase <mask> Reaction"
  
  ---
  
  # PMC pretrained RoBERTa large model
  Pretrained on PMC fulltext paragraphs on masked language modeling task, it's mostly biology/ medical papers