Kyudan
/

transformer_Eng_to_Kor

Model card Files Files and versions Community

직접 구현한 Transformer 및 RoPE로 영어->한국어 번역 모델 제작

약 13만쌍의 영어-한국어 데이터로 scratch training.

num_epochs = 5
batch_size = 64
config.intermediate_size = 768*4
config.num_attention_heads = 6
config.num_hidden_layers = 8

Orange is val_loss and Blue is loss

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Dataset used to train Kyudan/transformer_Eng_to_Kor