Thanks so much for the reply!
My word-level model (with embedding) gave really poor performance and then didn’t increase accuracy over time. Now, I had it on a very small embedding dimension (10), could that have been the problem?