 Evaluation results We evaluate the models on the same 505 validation Nahuatl sentences for a fair comparison. Finally, we report the results using chrf and sacrebleu hugging face metrics:  | English-Spanish pretraining  | Validation loss | BLEU | Chrf   | |:----------------------------:|:---------------:|:-----|-------:| | False                        | 1.34            | 6.17 | 26.96  |  | True                         | 1.31            | 6.18 | 28.21  |    The English-Spanish pretraining improves BLEU and Chrf and leads to faster convergence. The evaluation is available on the [eval.ipynb](https://github.com/milmor/spanish-nahuatl-translation/blob/main/eval.ipynb) notebook.   