When using torch.nn.parallel.DistributedDataParallel to train network, I’ve got " please add find_unused_parameters=True into DistributedDataParallel " error. After adding this flag into DistributedDataParallel,  I can train the network normally.
I know the reason why the error occurs is that the network has some unused parameters. I wonder whether we have some tools to find what they are.