To be specific like you asked, dist_autograd timed out in around 58 seconds. I put a timestamp before dist_autograd.backward(context_id, [losses])  then calculated the duration when it threw ETIMEDOUT error.