I’m not clear on how this is an issue with DistributedDataParallel which does not in itself do any pickling. Could you share a minimal script that reproduces the issue you’re seeing so we can debug further? Thanks!