fp8 gguf versions of FastHunyuan

#4
by boyetosekuji - opened

FastHunyuan is an accelerated HunyuanVideo model. It can sample high quality videos with 6 diffusion steps. That brings around 8X speed up compared to the original HunyuanVideo with 50 steps.
https://huggingface.co/FastVideo/FastHunyuan
https://x.com/TXhunyuan/status/1869282002786292097

this needs to happen! keep up the good work

would be great hopefully city96 sees the request

Please please please, GGUF of FastHunyuan!

Please please please, GGUF of FastHunyuan!

there is a fp8 version and i am using it hunyuan_video_FastVideo_720_fp8_e4m3fn.safetensors here https://huggingface.co/Kijai/HunyuanVideo_comfy/tree/main, i have not checked how fast it is vs the distill version.

i prefer GGUF Q8. Usually better than FP8

Please please please, GGUF of FastHunyuan!

there is a fp8 version and i am using it hunyuan_video_FastVideo_720_fp8_e4m3fn.safetensors here https://huggingface.co/Kijai/HunyuanVideo_comfy/tree/main, i have not checked how fast it is vs the distill version.

It's 12GB against Q4 which requires only 8GB card. I also tried a Hunyuan's block swap node in ComfyUI to handle my 8GB limit, but got a crash on sampler stage.

Sign up or log in to comment