@ptrblck Thats interesting, and Im not sure how much sense it makes.



 ptrblck:

The UnpicklingError error might be raised, if pickle isn’t able to load a specific fine, if it the binary file is corrupt (e.g. due to a failed download).
If that’s the case, disabling shuffle and rerunning the script should yield the error at the same index.


I tried with shuffle=False, but the behaviour is still the same.
Also, I would think that since it works with num_workers=0 then files are loaded successfully in this case.
I added some print functions around for-loop as follows:
            print("Before batch")
            for batch in loader: # Get Batch
                print("After batch")

For num_workers>0 the line Before batch is being printed, while the line After batch is not.
Could it be related to some peculiarities in AMD processors (my case), compared to Intel?
Are there other tests I could perform to narrow down the issue?