what is adaptive_quantile?

#70
by shivshankar - opened

what is adaptive_quantile? when to use it?

It's just different way of saving the LoRA, instead of a single rank, every layers rank is calculated individually, potentially making it more efficient for it's size. This is a method also known from Lycoris:

https://github.com/KohakuBlueleaf/LyCORIS

Sign up or log in to comment