Came here to ask the same thing.
And the use of the term ‘checkpoint’ as ‘trading compute for memory’ is confusing me.  In common CS parlance, ‘checkpointing’ refers to the practice of saving a program’s state so that it can be resumed if failure occurs.  But I don’t see any specification of a file path (for saving) in the torch.utils.checkpoint.checkpoint spec.