Unfortunately, it is a limitation of the checkpoint module. At least one input to the module needs to require gradients.
Since usually, the first module of your net has some weights that require gradients, it should not have any impact on the graph that is created.