What is the machine precision when working with pytorch? I know from (https://www.cfd-online.com/Wiki/Machine_precision 5) that for 32 bit computer its:
2^-52 ~ 10^-16 for double
2^-23 ~ 10^-7 for single
Does that mean that for torch.FloatTensor we have 2^-23 ~ 10^-7? and for 64 bit we get: 2^-104 ~ 10^ -32?
I’m not sure how to actually check this but in numpy/python one can do as its done here https://stackoverflow.com/questions/19141432/python-numpy-machine-epsilon 20
but if you throw in torch it doesn’t work:
>>> np.finfo(torch.FloatTensor)
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/Users/user/miniconda3/envs/hbf_env/lib/python3.6/site-packages/numpy/core/getlimits.py", line 392, in __new__
    raise ValueError("data type %r not inexact" % (dtype))
ValueError: data type <class 'numpy.object_'> not inexact