pytorch gpt_neo causal-lm he transformers license:mit text-generation
.gitattributes README.md config.json merges.txt pytorch_model.bin special_tokens_map.json tokenizer_config.json vocab.json
---
language: he

thumbnail: https://avatars1.githubusercontent.com/u/3617152?norod.jpg
widget:
- text: "שתי רכבות דוהרות בתוך עיני"
- text: "הים כחול ואני"
- text: "שם היצירה:"
- text: "רציתי"

license: mit
---

# hebrew_poetry-gpt_neo-tiny

Hebrew poetry text generation model, fined tuned upon [hebrew-gpt_neo-tiny](https://huggingface.co/Norod78/hebrew-gpt_neo-tiny) which was trained using [EleutherAI's gpt-neo](https://github.com/EleutherAI/gpt-neo). Each was trained on a TPUv3-8 which was made avilable to me via the [TPU Research Cloud](https://sites.research.google/trc/) Program.

## Datasets

1. Text from [New stage](http://stage.co.il/)
2. A dataset containing Hebrew lyrics
