Results of the first run:
{
“epoch”: 30.0,
“eval_loss”: 0.4920000433921814,
“eval_mem_cpu_alloc_delta”: 118951837,
“eval_mem_cpu_peaked_delta”: 44984344,
“eval_mem_gpu_alloc_delta”: 0,
“eval_mem_gpu_peaked_delta”: 6326542848,
“eval_runtime”: 145.0179,
“eval_samples”: 1503,
“eval_samples_per_second”: 10.364,
“eval_wer”: 0.5470570952893938,
“init_mem_cpu_alloc_delta”: 10150057,
“init_mem_cpu_peaked_delta”: 18306,
“init_mem_gpu_alloc_delta”: 1261919232,
“init_mem_gpu_peaked_delta”: 0,
“train_mem_cpu_alloc_delta”: 2815161,
“train_mem_cpu_peaked_delta”: 300144618,
“train_mem_gpu_alloc_delta”: 3787529728,
“train_mem_gpu_peaked_delta”: 14746535424,
“train_runtime”: 13357.7567,
“train_samples”: 3466,
“train_samples_per_second”: 0.245
}
I forgot to remove " character in the preprocessing stage. I’ll try to remove it and run it again.
Hyperparams were the same as in Turkish.