Hi, I have a rather complex network structure that has a lot of python code in the forward pass. When I run it, the GPU is utilized only 50% while the CPU utilization is 600%. My guess is that the python code is the bottleneck and the whole thing is CPU bound, so I can’t use multiple GPUs available in my system to speed it up.
I was wondering if I could speed it up somehow? I am waiting for the JIT availability and would want to try it even in pre-release state. Are there any instructions on how to compile/use pytorch with JIT?
Thank you!
Art