It’s well-established that DataParallel performs poorly in Python. Does anyone have anecdotal experience with DataParallel in C++? I assume that it can achieve performance on par with DistributedDataParallel since there’s no GIL contention but it would be really helpful to hear real experiences with it before invest in switching from Python to C++.