Is there a way to include RAdam and Look Ahead in pytorch models.
I tried the below approach from is-there-a-pytorch-implementation-of-radam-lookahead 59
from radam import RAdam
from optimizer import Lookahead
base_optim = RAdam(model.parameters(),lr = 0.001) 
optimizer =  Lookahead(base_optim, k=5, alpha=0.5)

but getting ModuleNotFoundError: No module named 'optimizer'.