Confuse by  "All learning rates are 0"
transformers/examples/seq2seq/finetune.py  219row :
        if max(scheduler.get_last_lr()) > 0:
            warnings.warn("All learning rates are 0")

why, is there something i left?

I've got the same problem here. Have you solved it?<|||||>Same here. Any solution to solve? Or is this just a warning message that can be ignored?<|||||>Pinging @sshleifer <|||||>Ignore it. I will try to get it out of the code. I think the lr starts at 0 and climbs up for `warmup_steps` iterations.