Dear Stas
Thank you very much, I will file an issue on this as you suggested. Sorry for the delays, I got a bit distracted by another issue as mt5 gets NaN with deepspeed, I will try to open up two separate issues for these if this can be appropriate, following the structure you mentioned.
Thank you very much for all kind help.