The DataLoader processes should be independent from the DistributedDataParallel processes.
You could try to use pandas to read and process your JSON data (I’m always using it, as it’s quite easy to further process the DataFrames).
Let me know, if that helps.