---
license: apache-2.0
datasets:
- pietrolesci/pubmed-200k-rct
metrics:
- accuracy
base_model:
- openai-community/gpt2
tags:
- medical
- biology
- research
- pubmed
model-index:
- name: MedGPT
  results: []
  demo:
  - name: Try in Space
    url: https://huggingface.co/spaces/devmanpreet/Medical-GPT2-Classifier
---

# MedGPT — GPT-2 Fine-Tuned on PubMed RCT

MedGPT is a GPT-2 model fine-tuned on the `pubmed-200k-rct` dataset. It classifies individual sentences from biomedical abstracts into one of five standard sections:

- Background  
- Objective  
- Methods  
- Results  
- Conclusion

This model is useful for tasks requiring structured understanding or summarization of scientific literature.

## Training Details

- Base Model: `gpt2` (124M parameters)  
- Dataset: `pietrolesci/pubmed-200k-rct`  
- Task: Sentence classification  
- Labels: Background, Objective, Methods, Results, Conclusion  
- Epochs: 1 (partial training)  
- Loss Function: CrossEntropy  
- Optimizer: AdamW