Solved by ptrblck in post #2 
              
              
                You are seeing the limited floating point precision using float32. 
If you need more precision, you could cast all tensors and the parameters to double.