content.raw: Did some little experimentation to resize pre-trained LoRAs on Flux. I explored two themes:
content.type: text
content.value: Did some little experimentation to resize pre-trained LoRAs on Flux. I explored two themes:
content.type: new_line
content.type: new_line
content.raw: * Decrease the rank of a LoRA
content.type: text
content.value: * Decrease the rank of a LoRA
content.type: new_line
content.raw: * Increase the rank of a LoRA
content.type: text
content.value: * Increase the rank of a LoRA
content.type: new_line
content.type: new_line
content.raw: The first one is helpful in reducing memory requirements if the LoRA is of a high rank, while the second one is merely an experiment. Another implication of this study is in the unification of LoRA ranks when you would like to 
content.type: text
content.value: The first one is helpful in reducing memory requirements if the LoRA is of a high rank, while the second one is merely an experiment. Another implication of this study is in the unification of LoRA ranks when you would like to 
content.code: torch.compile()
content.raw: `torch.compile()`
content.type: inline_code
content.raw:  them. 
content.type: text
content.value:  them. 
content.type: new_line
content.type: new_line
content.raw: Check it out here: 
content.type: text
content.value: Check it out here: 
content.type: new_line
content.raw: https://huggingface.co/sayakpaul/flux-lora-resizing
content.id: sayakpaul/flux-lora-resizing
content.type: model
content.type: resource
content.url: https://huggingface.co/sayakpaul/flux-lora-resizing
rawContent: Did some little experimentation to resize pre-trained LoRAs on Flux. I explored two themes:
  
  * Decrease the rank of a LoRA
  * Increase the rank of a LoRA
  
  The first one is helpful in reducing memory requirements if the LoRA is of a high rank, while the second one is merely an experiment. Another implication of this study is in the unification of LoRA ranks when you would like to `torch.compile()` them. 
  
  Check it out here: 
  https://huggingface.co/sayakpaul/flux-lora-resizing
reactions.reaction: 🚀
reactions.users: John6666 YaTharThShaRma999 AtAndDev Joseph717171 Svngoku
reactions.reaction: 🔥
reactions.users: John6666 YaTharThShaRma999 AtAndDev Joseph717171
reactions.reaction: 👍
reactions.users: John6666 AtAndDev Joseph717171 louisbrulenaudet
reactions.reaction: ❤️
reactions.users: John6666 AtAndDev Joseph717171
commentators._id: 6640bbd0220cfa8cbfdce080
commentators.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/6640bbd0220cfa8cbfdce080/wiAHUu5ewawyipNs0YFBR.png
commentators.fullname: John Smith
commentators.name: John6666
commentators.type: user