Solved by Ben_Harper in post #2 
              
              
                In my original question, I was using PyTorch v1.0.1. 
Now, I just built PyTorch/LibTorch from latest master (2019-03-02), and it WORKS! 
So PSA: Don’t try using RNNs from LibTorch on v1.0.1 branch. Build off master instead.