Hungarian ModernBERT-base

Model & tokenizer pretrained from scratch only on cleaned(removal of toxic and sexual content, automatic language correctness filtering) and semantically segmented Hungarian text.

Vocab: 52k

Context length of up to 8,192 tokens

Train dataset: ~1billion tokens

Downloads last month
16
Safetensors
Model size
151M params
Tensor type
F32
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for GaborMadarasz/ModernBERT-base-hungarian

Finetuned
(593)
this model

Dataset used to train GaborMadarasz/ModernBERT-base-hungarian

Collection including GaborMadarasz/ModernBERT-base-hungarian