transformers safetensors biogpt text-generation en license:mit autotrain_compatible endpoints_compatible region:us
---
language: en
license: mit
widget:
- text: What is antibiotic resistance?</s>
inference:
  parameters:
    max_new_tokens: 25
---

## ABR-Finetuned-BioGPT

Many LLM's have general capabilities, but many times domain specific knowledge is more important. To fill this gap we took the BioGPT model pretrained on a large set 
of biomedical abstracts and finetuned it on antibiotic resistance abstracts. But to get closer to a chatgpt like model some question and answering datasets where used
to achieve this.

### Data Trained On

#### Medical Domain Data
- qiaojin/PubMedQA
- Amirkid/MedQuad-dataset
- PubMed ABR abstracts
- medalpaca/medical_meadow_medical_flashcards
- medalpaca/medical_meadow_wikidoc

#### General Question Answering
- tatsu-lab/alpaca