I’m wondering about the behavior of quantization observer, e.g. HistogramObserver, when the model is wrapped with DistributedDataParallel ?
Will the estimated histograms (or min/max values) synchronized across multiple GPUs?