Solved by xta0 in post #2 
              
              
                Hi @mark_jimenez, can you add these two lines before running forward 
torch::autograd::AutoGradMode guard(false);
at::AutoNonVariableTypeMode non_var_type_mode(true);

The first one tells the engine to disable autograd, the second one is sort of a workaround. We can get rid of it in 1.4.0 which will…