Hi, how did you measure the execution time of loss.backward()? You have done a considerable amount of computation in [models[i](x) for i in range(100)], which I guess is the source of longer execution time.