I’m not sure this project will be very useful for Persian. It’s much better to to pretrain a new model from scratch for Persian directly. The mc4 2 dataset also has a Persian subset which you can use for pretraining.