Hello,
maybe i missing something, but my tests failed on  CosineAnnealingWarmRestarts creation,
the problem is:
    super(CosineAnnealingWarmRestarts, self).__init__(optimizer, last_epoch)

    self.T_cur = self.last_epoch

the super class call the override step function that use self.T_cur that is not defined.
i open a bug report(https://github.com/pytorch/vision/issues/2119 6), but if i missed something please let me know
thanks