Can you try by building a language model (train.py) with the first-half of sentences and then predict the next half (generate.py) as outlined in below tutorial?

  
      
      GitHub
  
  
    

pytorch/examples 23

A set of examples around pytorch in Vision, Text, Reinforcement Learning, etc. - pytorch/examples