Atlas3D: Physically Constrained Self-Supporting Text-to-3D for
  Simulation and Fabrication
Existing diffusion-based text-to-3D generation methods primarily focus on
producing visually realistic shapes and appearances, often neglecting the
physical constraints necessary for downstream tasks. Generated models
frequently fail to maintain balance when placed in physics-based simulations or
3D printed. This balance is crucial for satisfying user design intentions in
interactive gaming, embodied AI, and robotics, where stable models are needed
for reliable interaction. Additionally, stable models ensure that 3D-printed
objects, such as figurines for home decoration, can stand on their own without
requiring additional supports. To fill this gap, we introduce Atlas3D, an
automatic and easy-to-implement method that enhances existing Score
Distillation Sampling (SDS)-based text-to-3D tools. Atlas3D ensures the
generation of self-supporting 3D models that adhere to physical laws of
stability under gravity, contact, and friction. Our approach combines a novel
differentiable simulation-based loss function with physically inspired
regularization, serving as either a refinement or a post-processing module for
existing frameworks. We verify Atlas3D's efficacy through extensive generation
tasks and validate the resulting 3D models in both simulated and real-world
environments.
66588cb74c910980218efed0
Yunuo Chen
admin_assigned
2024-05-31T11:23:04.578Z
65a47b4d60cc6b04c9ebb0ff
/avatars/b35ae99eab95e95a327c30b6d3ad6c83.svg
Yunuo Chen
user
yunuoch
66588cb74c910980218efed1
Tianyi Xie
admin_assigned
2024-05-31T11:23:10.366Z
655e400e5afa950b64ba25aa
https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/xMw-tD_TMQlDtlNG7nUPm.jpeg
Tianyi Xie
user
XPandora
66588cb74c910980218efed2
Zeshun Zong
admin_assigned
2024-05-31T11:23:16.456Z
6615cf16a0d3d76bfa0870e5
/avatars/4e84d6d28be7ee7293c2e777d6180f3a.svg
Zeshun Zong
user
zeshunzong
66588cb74c910980218efed3
Xuan Li
66588cb74c910980218efed4
Feng Gao
claimed_verified
2024-06-02T18:47:27.827Z
634754e49c33771558c2e6b8
/avatars/a64245ed552c2b5d59d9e83c9478a142.svg
Feng Gao
user
Fen9Ga0
66588cb74c910980218efed5
Yin Yang
extracted_pending
2024-05-30T14:27:05.560Z
655e23bec166f4c0a7c87208
https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/7zDJoxECjZicI_M5dRcNr.png
Yin Yang
user
yangzzzy
66588cb74c910980218efed6
Ying Nian Wu
66588cb74c910980218efed7
Chenfanfu Jiang
admin_assigned
2024-05-31T11:23:52.869Z
655683727be68c0961673f45
/avatars/cddca36c041fa04860a4d42c0feaa07f.svg
Chenfanfu Jiang
user
cffjiang
Atlas3D: Physically Constrained Self-Supporting Text-to-3D for
  Simulation and Fabrication
Existing diffusion-based text-to-3D generation methods primarily focus on
producing visually realistic shapes and appearances, often neglecting the
physical constraints necessary for downstream tasks. Generated models
frequently fail to maintain balance when placed in physics-based simulations or
3D printed. This balance is crucial for satisfying user design intentions in
interactive gaming, embodied AI, and robotics, where stable models are needed
for reliable interaction. Additionally, stable models ensure that 3D-printed
objects, such as figurines for home decoration, can stand on their own without
requiring additional supports. To fill this gap, we introduce Atlas3D, an
automatic and easy-to-implement method that enhances existing Score
Distillation Sampling (SDS)-based text-to-3D tools. Atlas3D ensures the
generation of self-supporting 3D models that adhere to physical laws of
stability under gravity, contact, and friction. Our approach combines a novel
differentiable simulation-based loss function with physically inspired
regularization, serving as either a refinement or a post-processing module for
existing frameworks. We verify Atlas3D's efficacy through extensive generation
tasks and validate the resulting 3D models in both simulated and real-world
environments.
Atlas3D enhances text-to-3D generation by ensuring physical stability and self-supporting models through a simulation-based loss function and regularization.
diffusion-based text-to-3D generation Score Distillation Sampling differentiable simulation-based loss function physical constraints stability gravity contact friction refinement post-processing module