Hi @apaszke
Sr to bring this up again, but no one answers my question about this.
When following the example code of Hogwild, I found out that the model’s params can be partially changed when I’m doing the forwarding on it.
Do you use any kinds of semaphore or mutex when optim.step or forwarding the model?