Hello again,
I did save the optimizer and reloaded it in session and the loss continued to decline from the previous epochs.  When I did this in a subsequent session, the loss would bounce back up to the approximate loss from the first epoch.
Is the loss function a static construct?  Should I be saving the loss function and reloading it next session?
Thanks ptrblck