I put a print code to know when a single loss backward finished. There was almost one hour gap between two output of the print code.
I wrote the code in google colab. If it helps, I can send you the link of my code.