The save_checkpoint 5 method from the ImageNet example uses the is_best argument to only store the best model. This is_best flag is created by checking the current metric and comparing it to the currently best one from previous iterations.