You mean the GPU loading directly from a drive? Nvidia has a separate technology for that, but it specifically requires hardware support for PCIe P2P and workstation or data centre accelerator cards, along with limited software support (Ubuntu only, for instance). I don’t know if directly loading into the GPU without going through the CPU is doable in CUDA alone, though, but communicating from storage to GPUs is also possible because of texture streaming.
One thing to think about is if the 20ms it takes to transfer to the GPU is really going to be a bottleneck when working on more than one file compared to processing time.