To add to @jaredtnielsen answers I think you shouldn’t have any issue of memory if you are using PyTorch + nlp, it will be fully lazy loading from the drive, almost nothing in RAM (just your current batch, plus the model of course)