pytorch jax gpt2 lm-head causal-lm en it scn nap transformers exbert license:apache-2.0 text-generation
.gitattributes README.md config.json flax_model.msgpack merges.txt pytorch_model.bin special_tokens_map.json tokenizer_config.json vocab.json scripts/01_prepare-bonaffini.pl scripts/02_initialize-gptalian.py scripts/03_pretrain-gptalian.sh scripts/04_play-w-gptalian.ipynb scripts/LICENSE scripts/run_clm.py
---

language:
- en
- it
- scn
- nap

tags:
- exbert
- gpt2

license: apache-2.0

---

# GPTalian

This is a GPT2 model of Italian regional languages trained on [collections of Italian "dialect poetry"](http://dialectpoetry.com) by Luigi Bonaffini.

This is a multilingual model.  Italians use the word "dialect" to describe their regional languages, but they are separate languages.  And there's a lot of English in this dataset too.

The challenge of this project is to train a model to write the languages of Italy.

For those who do not know Italian, here's some (lowercase) text that you can type into the API box:

- oggi si parla il dialetto
- la sua poesia viene di
- ma non sempre trova
