Solved by xta0 in post #4 
              
              
                @DTSED @mark_jimenez can you guys try adding torch::autograd::AutoGradMode guard(false); before calling torch.jit.load and forward? 
    at::AutoNonVariableTypeMode nonVarTypeModeGuard(true);
    torch::autograd::AutoGradMode guard(false);
    auto model = torch::jit::load(path.UTF8String);
    auto…