Dante's Inferno Poetry Generator

This model generates poetry inspired by Dante's Inferno. It was fine-tuned on the text from Project Gutenberg using GPT-2 with proper attention mask handling.

Model Details

Base Model: GPT-2 (small)
Training Data: Dante's Inferno (English translation from Project Gutenberg)
Special Features: Custom pad token for improved generation quality
Purpose: Generate Dante-inspired poetry

Usage

from transformers import GPT2LMHeadModel, GPT2Tokenizer

model = GPT2LMHeadModel.from_pretrained('anasalter/dante-inferno-gpt2')
tokenizer = GPT2Tokenizer.from_pretrained('anasalter/dante-inferno-gpt2')

prompt = "In the middle of"
inputs = tokenizer(prompt, return_tensors='pt')
outputs = model.generate(
    inputs['input_ids'],
    attention_mask=inputs['attention_mask'],
    max_length=100,
    temperature=0.8,
    do_sample=True,
    pad_token_id=tokenizer.pad_token_id
)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))

Training Details

3 epochs on Google Colab
Learning rate: 5e-5
Batch size: 4 with gradient accumulation
Custom pad token to avoid attention mask issues