Solved by Vasiliy_Kuznetsov in post #2 
              
              
                Softplus currently does not have a quantized implementation.  This error also usually means that a quantized tensor is being passed to a non-quantized function. 
For a quick fix, you could add a torch.quantization.DeQuantStub() and torch.quantization.QuantStub() around the areas of the network which…