hi, I have recently read Announcing the Amazon S3 plugin for PyTorch | AWS Machine Learning Blog 12 which is your answer. however, if you are not comfortable with it, you can assume your data as stream and use Handling streaming data 4