Turbo3D: Ultra-fast Text-to-3D Generation
We present Turbo3D, an ultra-fast text-to-3D system capable of generating
high-quality Gaussian splatting assets in under one second. Turbo3D employs a
rapid 4-step, 4-view diffusion generator and an efficient feed-forward Gaussian
reconstructor, both operating in latent space. The 4-step, 4-view generator is
a student model distilled through a novel Dual-Teacher approach, which
encourages the student to learn view consistency from a multi-view teacher and
photo-realism from a single-view teacher. By shifting the Gaussian
reconstructor's inputs from pixel space to latent space, we eliminate the extra
image decoding time and halve the transformer sequence length for maximum
efficiency. Our method demonstrates superior 3D generation results compared to
previous baselines, while operating in a fraction of their runtime.
675306120d314916ecfd5e0c
Hanzhe Hu
claimed_verified
2024-12-09T11:06:52.310Z
6732a2fc7a4e00e8f05816c4
/avatars/b213d7b8390712b9ced85844db3b5ec9.svg
Hanzhe Hu
user
howard06
675306120d314916ecfd5e0d
Tianwei Yin
admin_assigned
2024-12-18T13:45:17.166Z
63363b864067f020756275b7
/avatars/bf18f9f76183f81589a80b3d0215f1a5.svg
Tianwei Yin
user
tianweiy
675306120d314916ecfd5e0e
Fujun Luan
admin_assigned
2024-12-18T13:44:46.224Z
662ae0aa4f711ee4e1e17ffc
https://cdn-avatars.huggingface.co/v1/production/uploads/662ae0aa4f711ee4e1e17ffc/nEi6tv8f6DIhTauwHpw_C.jpeg
Fujun Luan
user
luanfujun
675306120d314916ecfd5e0f
Yiwei Hu
admin_assigned
2024-12-18T13:44:39.779Z
6420f17ee40f66bcd1e6ad40
/avatars/ff1f90ab896a0ebd0f30e9df5fcb84bf.svg
Yiwei Hu
user
Crymson-H
675306120d314916ecfd5e10
Hao Tan
675306120d314916ecfd5e11
Zexiang Xu
admin_assigned
2024-12-18T13:44:25.134Z
65565b1b8616d8d740abb976
/avatars/c245b19ed05292bf1bf4a9d8cf2a409c.svg
Zexiang Xu
user
zexiangxu
675306120d314916ecfd5e12
Sai Bi
admin_assigned
2024-12-18T13:44:32.836Z
66303560597dc7c535168f07
/avatars/a69d52a4a198c6c8451c1d137031bf07.svg
Sai Bi
user
saibi
675306120d314916ecfd5e13
Shubham Tulsiani
675306120d314916ecfd5e14
Kai Zhang
Turbo3D: Ultra-fast Text-to-3D Generation
We present Turbo3D, an ultra-fast text-to-3D system capable of generating
high-quality Gaussian splatting assets in under one second. Turbo3D employs a
rapid 4-step, 4-view diffusion generator and an efficient feed-forward Gaussian
reconstructor, both operating in latent space. The 4-step, 4-view generator is
a student model distilled through a novel Dual-Teacher approach, which
encourages the student to learn view consistency from a multi-view teacher and
photo-realism from a single-view teacher. By shifting the Gaussian
reconstructor's inputs from pixel space to latent space, we eliminate the extra
image decoding time and halve the transformer sequence length for maximum
efficiency. Our method demonstrates superior 3D generation results compared to
previous baselines, while operating in a fraction of their runtime.
Turbo3D, an ultra-fast text-to-3D system using a 4-step, 4-view diffusion generator and latent space Gaussian reconstructor, achieves high-quality 3D generation in less than a second
diffusion generator Gaussian reconstructor latent space Gaussian splatting Dual-Teacher approach view consistency photo-realism transformer sequence length