Does it work with ComfyUI?
Hi,
I wanted to try it out in ComfyUI, but I get an error:
"ERROR: controlnet file is invalid and does not contain a valid controlnet model."
Is it compatible with ComfyUI? Thanks in advance!
same here
same here
What workflow did you use?
Wasn't able to find controlnet workflow for Flux.2
Same here...there is a ControlNet for the new Zimage. Comfyui had to create some nodes to make that work. Probably the same situation. Looks like Zimage is getting all the attention.
Same here:
File "/home/user/app/ComfyUI/nodes.py", line 815, in load_controlnet
raise RuntimeError("ERROR: controlnet file is invalid and does not contain a valid controlnet model.")
RuntimeError: ERROR: controlnet file is invalid and does not contain a valid controlnet model.
I'm working on it,
but it comes out kind of wrong...
It should look like this...
Try to use ReferenceLatent node and place it:
- after 'Apply VideoX ControlNet' and before 'BasicGuider'
- after 'FluxGuidance' and before 'Apply VideoX ControlNet'
nodes to see what will happen
I've about got it. I'm going to clean it up and get it in GitHub after verifying it with more control images and pinpointing is verified. But it's looking good, I think.
pinpointing! Thanks, Apple, I typed INPAINTING!
VAE patchify and RoPE worked out:
Canny seems to work well too
Thank Claude, I more or less vibe-coded this shiz. It seems to work as expected, though.
where do you get the VideoX controlNet Loader _V2
From me. When it finally works I'll share a link.
Depth is working
Inpainting is just meh. It's not going to be good until Black Forest Labs releases a proper fill checkpoint.
I need to get some sample workflows together, some notes, and proper naming because we also need to get a ZIT version as well.
I decided to just go ahead and share. It's not tested with any checkpoints besides the regular bf16 flux.2-dev weights. Hopefully this will work for some of you.