Hi, I am using PyTorch to do a regression task.
Mainly I am using the neural network to approximate some values given some inputs.
But I found that the order of magnitude of approximation accuracy is about 10^-5.
For a deeper neural network this stays the same.
I am wondering if this could be the result of training with single-precision floating-points?