No! fp32 has as 23 bit significand, so the lowest bit is about 2^(-23)~10^(-7) in magnitude. This is roughly the relative precision of the representation. If you now compute with that, you lose some accuracy, and 1e-5ish is relatively reasonable. It also matches my experience in general.