For supporting material see this paper (especially the first footnote):

  
      arxiv.org
  
  
    
1412.3555.pdf

667.87 KB

  
  
    
    
  
  


This change from the original GRU allows all of the W_{...} h operations to be performed at once, which improves performance.