So similar to how you would otherwise track overfitting, only with PPL as a metric. I find that my eval loss is increasing quite rapidly when finetuning, but that still generations are not really sensible nor adapted to the new domain. If you have any ideas, shoot!