Programmatic Invokation
#5
by
luckielordie
- opened
Is there a way you can invoke these files programmatically, ala Diffusers? The examples I've seen still require loading the original model and just end up replacing the transformers part of the pipeline with the GGUF.
All other examples I've seen use frameworks and apps like ComfyUI. I'm looking for a way of invoking these models programmatically.
@city96 Can you help here?
I was reading your ComfyUI plugin, which I think is about the only way to run GGUF quantisations of diffusion models from what I can find online. I didn't understand most of what I was looking at, I'm afraid, but any info you can share would be appreciated.