Solved by Vasiliy_Kuznetsov in post #2 
              
              
                The fix would be to specify kernel size directly instead of dynamically inferring it from the input tensor.  At the moment, this is a restriction of symbolic tracing. 
Note: there will be more docs posted on this when FX graph mode quantization is officially released, ideally soon.