@Nathan_Wood concerning Ignite 9, we have Checkpoint class 8 that can be used to store 1) training checkpoints with model, optimizer, lr scheduler etc and 2) best N models.
Complete example of usage can be found here 24.
HTH
PS: Please, take a look and feel free to leave us a feedback