Solved by Irfan_Bulu in post #14 
              
              
                h and c are not learned parameters. Check this example please: 
http://pytorch.org/tutorials/beginner/nlp/sequence_models_tutorial.html#example-an-lstm-for-part-of-speech-tagging