I had this same problem; admin at our university thought they should save money on a server with 4 Titan X’s and not get an SSD for it. Made tensorpack’s sequential loader 252 even easier to use in PyTorch: https://github.com/BayesWatch/sequential-imagenet-dataloader 661