Hi and thanks in advance for the help! This is more of a general question but I’m attempting to implement Barlow Twins using Pytorch Lightning. I’m unsure of how to use this LARS wrapper (pl_bolts.optimizers.lars_scheduling module — PyTorch-Lightning-Bolts 0.2.1 documentation) with the configure_optimizer function in Pytorch lightening. Would I just wrap an Adams optimizer with this and that would be the sole item returned by the function? Additionally in Barlow twins, the LR had a warm-up scheduling - would this need to be implemented separately or is this taken care of in the implementation or the LARS wrapper?
Thanks again for the help!