I assume you are not shuffling the data using your DataLoader, since the losses seem to be quite deterministic.
Are you detaching the computation graph accidentally in your model’s forward method?
Also, are you using a custom loss function or a PyTorch one?