@ptrblck could I get a little more info on how this works? I’m assuming __getitem__ eventually gets called on the dataset so as long as what gets returned there is the desired result then preprocessing is occurring.
One other question, the preparation step in my application is extensive and unavoidable. I’m thinking about using multiple threads to help the word go faster. Do I need to worry about how these processes affect what Pytorch is doing in preparing the data? (e.g. Pytorch thinks a thread isn’t being used when really I’ve just kicked up a process on it.)