Unleashing Vecset Diffusion Model for Fast Shape Generation
3D shape generation has greatly flourished through the development of
so-called "native" 3D diffusion, particularly through the Vecset Diffusion
Model (VDM). While recent advancements have shown promising results in
generating high-resolution 3D shapes, VDM still struggles with high-speed
generation. Challenges exist because of difficulties not only in accelerating
diffusion sampling but also VAE decoding in VDM, areas under-explored in
previous works. To address these challenges, we present FlashVDM, a systematic
framework for accelerating both VAE and DiT in VDM. For DiT, FlashVDM enables
flexible diffusion sampling with as few as 5 inference steps and comparable
quality, which is made possible by stabilizing consistency distillation with
our newly introduced Progressive Flow Distillation. For VAE, we introduce a
lightning vecset decoder equipped with Adaptive KV Selection, Hierarchical
Volume Decoding, and Efficient Network Design. By exploiting the locality of
the vecset and the sparsity of shape surface in the volume, our decoder
drastically lowers FLOPs, minimizing the overall decoding overhead. We apply
FlashVDM to Hunyuan3D-2 to obtain Hunyuan3D-2 Turbo. Through systematic
evaluation, we show that our model significantly outperforms existing fast 3D
generation methods, achieving comparable performance to the state-of-the-art
while reducing inference time by over 45x for reconstruction and 32x for
generation. Code and models are available at
https://github.com/Tencent/FlashVDM.
67dce2d2068292e7ef79b3dd
Zeqiang Lai
claimed_verified
2025-03-21T11:40:33.586Z
63044b89eedc089484c995ad
https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/T4mOIQLaQdM5_oviaw_Cp.png
Zeqiang Lai
user
ZeqiangLai
67dce2d2068292e7ef79b3de
Yunfei Zhao
admin_assigned
2025-03-21T12:00:37.346Z
619b8af6cbedb87e1a92e692
/avatars/1258fb2f2637adac8550100f3645651e.svg
YunFei Zhao
user
qikahh
67dce2d2068292e7ef79b3df
Zibo Zhao
admin_assigned
2025-03-21T12:00:43.511Z
62d8ce11c60d1450a1ed8795
/avatars/26f1ca693ad7106be0f2f469070d8500.svg
zibo.zhao
user
cocacola
67dce2d2068292e7ef79b3e0
Haolin Liu
67dce2d2068292e7ef79b3e1
Fuyun Wang
admin_assigned
2025-03-21T12:01:06.818Z
63e9e92f20c109718713f5eb
/avatars/9ff312e854d803e1a2e9e685a21d12f8.svg
Fu-Yun Wang
user
wangfuyun
67dce2d2068292e7ef79b3e2
Huiwen Shi
admin_assigned
2025-03-21T12:01:13.316Z
67287a522ae45f363dd0ad43
https://cdn-avatars.huggingface.co/v1/production/uploads/67287a522ae45f363dd0ad43/H6eyuxxSk6a84PzRoYcIU.png
huiwenshi
user
Huiwenshi
67dce2d2068292e7ef79b3e3
Xianghui Yang
67dce2d2068292e7ef79b3e4
Qinxiang Lin
67dce2d2068292e7ef79b3e5
Jinwei Huang
67dce2d2068292e7ef79b3e6
Yuhong Liu
67dce2d2068292e7ef79b3e7
Jie Jiang
67dce2d2068292e7ef79b3e8
Chunchao Guo
67dce2d2068292e7ef79b3e9
Xiangyu Yue
admin_assigned
2025-03-21T12:52:21.020Z
666a8f24e2990b0cb16b7bf9
/avatars/fcbaf8f1e3e53a2a4a819b7cb2c53aa4.svg
Xiangyu Yue
user
xyyue
Unleashing Vecset Diffusion Model for Fast Shape Generation
3D shape generation has greatly flourished through the development of
so-called "native" 3D diffusion, particularly through the Vecset Diffusion
Model (VDM). While recent advancements have shown promising results in
generating high-resolution 3D shapes, VDM still struggles with high-speed
generation. Challenges exist because of difficulties not only in accelerating
diffusion sampling but also VAE decoding in VDM, areas under-explored in
previous works. To address these challenges, we present FlashVDM, a systematic
framework for accelerating both VAE and DiT in VDM. For DiT, FlashVDM enables
flexible diffusion sampling with as few as 5 inference steps and comparable
quality, which is made possible by stabilizing consistency distillation with
our newly introduced Progressive Flow Distillation. For VAE, we introduce a
lightning vecset decoder equipped with Adaptive KV Selection, Hierarchical
Volume Decoding, and Efficient Network Design. By exploiting the locality of
the vecset and the sparsity of shape surface in the volume, our decoder
drastically lowers FLOPs, minimizing the overall decoding overhead. We apply
FlashVDM to Hunyuan3D-2 to obtain Hunyuan3D-2 Turbo. Through systematic
evaluation, we show that our model significantly outperforms existing fast 3D
generation methods, achieving comparable performance to the state-of-the-art
while reducing inference time by over 45x for reconstruction and 32x for
generation. Code and models are available at
https://github.com/Tencent/FlashVDM.
FlashVDM accelerates both diffusion sampling and VAE decoding in 3D diffusion models, achieving high performance with reduced inference times.
3D diffusion Vecset Diffusion Model VDM diffusion sampling VAE decoding FlashVDM DiT Progressive Flow Distillation lightning vecset decoder Adaptive KV Selection Hierarchical Volume Decoding Efficient Network Design FLOPs Hunyuan3D-2 Hunyuan3D-2 Turbo