@DTSED @mark_jimenez can you guys try adding torch::autograd::AutoGradMode guard(false); before calling torch.jit.load and forward?
    at::AutoNonVariableTypeMode nonVarTypeModeGuard(true);
    torch::autograd::AutoGradMode guard(false);
    auto model = torch::jit::load(path.UTF8String);
    auto input = torch::randn({3,784});
    auto output = model.forward({input});
    std::cout<<output.toTensor().sizes()<<std::endl;

Autograd features have been disabled on mobile, the current workaround is to use the RAII guard above. torch::autograd::AutoGradMode guard(false); is similar to with torch.no_grad(): in python.