Seems like the dataloader is gonna cast it to float anyways before serving the model. So basically the model gets the exact same data for both runs? Cant seem to be related to initalization, i tried both runs more than 20 times. Same result every time