From Babble to Words
Collection
The models, tokenizers and datasets used in From Babble to Words, one of the winning BabyLM 2024 submissions, exploring phoneme-based training.
•
12 items
•
Updated
GPT2 trained on the BabyLM 2024 training set (in IPA) using a BPE tokenizer with word boundaries removed.
Model trained for From Babble to Words: Pre-Training Language Models on Continuous Streams of Phonemes.
- Downloads last month
- 4
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
HF Inference deployability: The model has no library tag.
Model tree for phonemetransformers/GPT2-85M-BPE-PHON-SPACELESS
Base model
openai-community/gpt2