Hi Folks,
I am trying to implement this paper “https://arxiv.org/pdf/1701.01909.pdf 117”. In order to do that, I need to train a sequence-to-one network with following structure:

cnn_lstm.png766×504 59.8 KB

I need to train both the FC (i.e., \phi_{t}^A) and LSTM. I am  new to PyTorch, and I am not sure how to build the network by using PyTorch. I would appreciate any suggestion.