Your approach for testing should be fine. If you really want to use double during the entire training, you could certainly check if moving the transformation to the Dataset (or keeping the data directly in float64) could work.