autograd seems completely orthogonal to the headline issue (whether forward is special), but yes, for inference it probably makes sense to use with torch.no_grad(): or for p in model.parameters(): p.requires_grad_(False).
Best regards
Thomas