Yes, if no dropout (or any custom layers, which change the behavior using the self.training flag) are used, then the output should at least yield a max. absolute error of the floating point precision limit.