GPT-NoSleep-1.5b

This is the largest release of GPT-NoSleep; a finetuned version of GPT2-XL on the 'reddit-nosleep-posts' dataset. Smaller releases include:

• GPT-NoSleep-355m

And the accompanying prompt generator can be found here:

• Space for prompt generation
• The model

Training Procedure

This was trained on the 'reddt-nosleep-posts' dataset, on Google Colab. This model was trained for 2 epochs with learning rate 1e-2. Special thanks for Skyler for helping to train this large of a model!

Biases & Limitations

This likely contains the same biases and limitations as the original GPT2 that it is based on, and additionally heavy biases from the dataset. It can generate output that is not meant for all audiences, seeing as it's purpose is to generate horror stories.

Intended Use

This model is meant for fun, nothing else.