Do you want to remove the dropout for each of the training checkpoints? Then just do net.eval() for the checkpoint, and net.train() at the beginning of each step of your training loop (in order to restore dropouts).