what is adaptive_quantile?
#70
by
shivshankar
- opened
what is adaptive_quantile? when to use it?
It's just different way of saving the LoRA, instead of a single rank, every layers rank is calculated individually, potentially making it more efficient for it's size. This is a method also known from Lycoris: