xieydd:

I think i find where is the error, When i use DataParallel, it will be such an error, but when i use single gpu, will no error.


We recently fixed a bug with QAT and DataParallel, please try with pytorch nightly to see if the issue still persists. cc @Vasiliy_Kuznetsov