hm, and you are really sure that it’s increasing in the for-loop over the batches and not the for-loop over the epochs? Because the only thing I could see right now is that you are not closing the pickle file object (not sure if that’s necessary still, but personally, I always use the “with” context managers when dealing with files)