I searched inside https://pytorch.org/docs/master/optim.html 90 but haven’t found any Layer-wise AdaptiveRate Scaling optimizer LARS  108 implemented. Same for LAMB. Are there any plans soon? Should we add FR?