@ptrblck
Any pointers as to why grid would have Inf during mixed precision training only ?
following is the exact line where Infs  happen in half precision
pts_2d = torch.mm(pts_3d_rect, torch.transpose(proj_matrix, 0, 1))