Based on the code snippet it seems you are calling the complete model via checkpoint, which should not save any memory, or is this module just part of a larger model?
However, based on the issue description is seems that parts of the model might not be executed at all.