It does seem to be updating.

Screen Shot 2019-06-20 at 3.00.27 PM.png1200×1102 74.2 KB

Here is an image of the training for a couple epochs:

Screen Shot 2019-06-20 at 3.07.48 PM.png930×720 37.3 KB

When I retrain from scratch it trains just fine.