Solved by ptrblck in post #4 
              
              
                Thanks for the information. 

In that case you are adding synchronizations, as numpy uses CPU arrays. Your workflow would therefore probably be:

load data on CPU -> transfer to GPU and use MXNet model -> transfer back to CPU -> transform to PyTorch tensor and transfer back to GPU -> use forward pas…