@Ilya_Kostrikov - Quick question about your implementation:
Sorry in case it seems obvious to you, but I admittedly don’t have in-depth knowledge about (parallel) optimization algorithms. In your implementation, you moved the init of step, square_avg etc from step to __init__.
Is there another reason for this apart form the obvious, that we can’t call share_memory before calling step for the first time?
Cheers,
Deniz