Wouldn’t the ToTensor() transformation also work for your uint8 video frames or are you seeing another error?
Just transforming to float() sounds wrong, as the values would still be in the range [0, 255], while you are using mean and std stats for inputs in the range [0, 1], which will be the value range after using ToTensor() in unit8 inputs.