pytorch jax roberta masked-lm transformers fill-mask
.gitattributes README.md config.json flax_model.msgpack merges.txt pytorch_model.bin training_args.bin vocab.json
Beta-kavntorium-simple-small is a transformers model RoBerta pretrained on a large corpus of Russion kvantorim data in a self-supervised fashion. This means it was pretrained on the raw texts only, with no humans labelling them in any way (which is why it can use lots of publicly available data) with an automatic process to generate inputs and labels from those texts. More precisely, it was pretrained with objective:

Automate communication with the Quantorium community and mentors.



https://sun9-49.userapi.com/impg/CIJZKA_r9xoLYd47Lvjv_8jyu6epadPyergP3Q/zw3J_E6IlJo.jpg?size=546x385&quality=96&sign=139fa29b864d36958feab4731cc684dc&type=album