wan-gguf / README.md
calcuis's picture
Update README.md
b896e32 verified
|
raw
history blame
3.5 kB
---
license: apache-2.0
language:
- en
base_model:
- Comfy-Org/Wan_2.1_ComfyUI_repackaged
pipeline_tag: text-to-video
tags:
- gguf-node
widget:
- text: >-
a pig moving quickly in a beautiful winter scenery nature trees sunset tracking camera
parameters:
negative_prompt: >-
blurry ugly bad
output:
url: samples\ComfyUI_00007_.webp
- text: >-
a pig moving quickly in a beautiful winter scenery nature trees sunset tracking camera
parameters:
negative_prompt: >-
blurry ugly bad
output:
url: samples\ComfyUI_00009_.webp
- text: >-
a pig moving quickly in a beautiful winter scenery nature trees sunset tracking camera
parameters:
negative_prompt: >-
blurry ugly bad
output:
url: samples\ComfyUI_00003_.webp
- text: >-
a pig moving quickly in a beautiful winter scenery nature trees sunset tracking camera
parameters:
negative_prompt: >-
blurry ugly bad
output:
url: samples\ComfyUI_00004_.webp
- text: >-
a pig moving quickly in a beautiful winter scenery nature trees sunset tracking camera
parameters:
negative_prompt: >-
blurry ugly bad
output:
url: samples\ComfyUI_00005_.webp
- text: >-
a pig moving quickly in a beautiful winter scenery nature trees sunset tracking camera
parameters:
negative_prompt: >-
blurry ugly bad
output:
url: samples\ComfyUI_00006_.webp
- text: >-
a fox moving quickly in a beautiful winter scenery nature trees sunset tracking camera
parameters:
negative_prompt: >-
blurry ugly bad
output:
url: samples\ComfyUI_00002_.webp
- text: >-
a cute anime girl with massive fennec ears and a big fluffy tail wearing a maid outfit turning around
parameters:
negative_prompt: >-
blurry ugly bad
output:
url: samples\ComfyUI_00008_.webp
- text: >-
glass flower blossom
output:
url: samples\ComfyUI_00010_.webp
---
# **gguf quantized version of wan video**
- drag **gguf** to > `./ComfyUI/models/diffusion_models`
- drag **t5xxl-um** to > `./ComfyUI/models/text_encoders`
- drag **vae** to > `./ComfyUI/models/vae`
![screenshot](https://raw.githubusercontent.com/calcuis/comfy/master/wan-t2v.gif)
## **workflow**
- for i2v model, drag **clip-vision-h** to > `./ComfyUI/models/clip_vision`
- run the .bat file in the main directory (assume you are using gguf pack below)
- please use native clip loader instead of **gguf clip loader** for fp8 scaled t5xxl-um encoder; it works only with fp16 t5xxl-um right away; **gguf vae loader** works fine for both scaled safetensors and gguf vae
- drag any demo video (below) to > your browser for workflow
<Gallery />
## **review**
- `pig` is a lazy architecture for gguf node; it applies to all model, encoder and vae gguf file(s); if you try to run it in comfyui-gguf node, you might need to manually add `pig` in it's IMG_ARCH_LIST (under loader.py); easier than you edit the gguf file itself; btw, model architecture which compatible with comfyui-gguf, including `wan`, should work in gguf node
- 1.3b t2v **gguf** is working fine; good for old or low end machine
### **reference**
- base model from [wan-ai](https://huggingface.co/Wan-AI/Wan2.1-T2V-14B)
- comfyui from [comfyanonymous](https://github.com/comfyanonymous/ComfyUI)
- pig architecture from [connector](https://huggingface.co/connector)
- gguf-node ([pypi](https://pypi.org/project/gguf-node)|[repo](https://github.com/calcuis/gguf)|[pack](https://github.com/calcuis/gguf/releases))