readme: ---
  license: bigscience-openrail-m
  pipeline_tag: text-generation
  ---
  # gptj-neo-1.3B_finetuned-enusec-talks-22
  
  This model is GPT-J Neo 1.3B finetuned on the transcripts of around 30 [ENUSEC](https://enusec.org) Le Tour Du Hack (2019 and 2022) conference talks.
  The dataset used to finetune this model was created using [OpenAI's Whisper](https://openai.com/blog/whisper/) and [ENUSEC's public LTDH conference recordings](https://www.youtube.com/@enusec9134/videos) up to 15th Aug 2022.
  
  [View the wandb page here](https://wandb.ai/lewiswatson/gptj-neo-1.3B_finetuned-enusec-talks-22)
  
  ## Prompts
  
  The dataset used for finetuning used the format: {Talk title} ->; {Talk Transcript}
  For best results, prompts should also follow this format.