In my original question, I was using PyTorch v1.0.1.
Now, I just built PyTorch/LibTorch from latest master (2019-03-02), and it WORKS!
So PSA: Don’t try using RNNs from LibTorch on v1.0.1 branch. Build off master instead.