metadata

license: apache-2.0
library_name: transformers

Mistral Scary Story Finetune

This model is a finetune of mistralai/Mistral-7B-v0.1 using r/nosleep subreddit as data. This is not an instruction fine tuned model and only fine tuned on stories. To generate a story, give a title to model like:

# On a dark and spooky night

You can even write some of the story get a better result.

Training Procedure

This is a lora fine-tune with following parameters:

r=8,
lora_alpha=16,
lora_dropout=0.05