torchvision uses PIL by default, so you could check the result arrays in PIL vs. OpenCV, which might use different decoders etc.
It would also be interesting to see how large the abs().max() difference is between both arrays.