I wrote livelossplot 188 (live training loss plot in Jupyter Notebook for Keras, PyTorch and others) exactly for that purpose.
PyTorch example: https://github.com/stared/livelossplot/blob/master/examples/pytorch.ipynb 645