@ptrblck @googlebot Thank both for your comments!  Is it possible to have a deep CPU copy of the model at the end of each epoch, let the original model keeps training on GPU while at the same time this CPU copy does other computation?