Sorry, one more related question after running some more tests:
Multicore computations aren’t giving the factor speedup that I would expect. This could be caused by torch::NoGradGuard containing a Mutex mechanism. Does it?
Does the forward code on standard components (e.g. linear layers) contain mutexes?
Any other reason why this doesn’t seem to parallelize completely?