Solved by ptrblck in post #2 
              
              
                You could use matplotlib.pylot to plot multiple graphs in the same plot. 
Alternatively, PyTorch has also TensorBoard as well as Visdom support.