UPDATE 2:
By reducing the number of GRU layers from 2 to 1, the model is training well. I don’t understand why the training error would go up with a more complex model - shouldn’t it at worst level off? Any advise for why this might have happened would be appreciated.