Solved by Vasiliy_Kuznetsov in post #2 
              
              
                can you try to move your model to CPU and see if that fixes the error?  Currently quantized kernels are only supported on CPU.
yes, that is correct