LSTM has multiple outputs, which prevents the correct observation. You might want to try the “Quantizable LSTM”. Take a look at this test for an example: pytorch/test_quantized_op.py at bb21aea37add0400eaa4ea8317656b7469b38a94 · pytorch/pytorch · GitHub 24 Let me know if it’s confusion – I’ll make a simple writeup