Yes this example could be interpreted as in auto encoder. W1 or in this example C_t is passed through lstm1 and W2 or in this example C_t2 is passed through lstm2 through timesteps.
How you want to set this up though depends on what type of data your looking to use autoencoderwith model.

  
      
      GitHub
  
  
    

pytorch/examples 266

A set of examples around pytorch in Vision, Text, Reinforcement Learning, etc. - pytorch/examples