torchvision is quite fast.
Extracting images (on-the-fly) requires hardisk IO thus i doubt it were faster.
If you canextract images before hand that would be faster for sure as video is compressed and requires time to be decoded.