It’s ok in find_unused_parameters=False, so I guess maybe manually define checkpoint can solve my problem?
Thus, I modify the checkpoint to save the variable(indicating which part to forward), and get output again in backward with this variable.
But it makes new problems (Not Enough Values to unpack in backward)…