NExT-Mol: 3D Diffusion Meets 1D Language Modeling for 3D Molecule
  Generation
3D molecule generation is crucial for drug discovery and material design.
While prior efforts focus on 3D diffusion models for their benefits in modeling
continuous 3D conformers, they overlook the advantages of 1D SELFIES-based
Language Models (LMs), which can generate 100% valid molecules and leverage the
billion-scale 1D molecule datasets. To combine these advantages for 3D molecule
generation, we propose a foundation model -- NExT-Mol: 3D Diffusion Meets 1D
Language Modeling for 3D Molecule Generation. NExT-Mol uses an extensively
pretrained molecule LM for 1D molecule generation, and subsequently predicts
the generated molecule's 3D conformers with a 3D diffusion model. We enhance
NExT-Mol's performance by scaling up the LM's model size, refining the
diffusion neural architecture, and applying 1D to 3D transfer learning.
Notably, our 1D molecule LM significantly outperforms baselines in
distributional similarity while ensuring validity, and our 3D diffusion model
achieves leading performances in conformer prediction. Given these improvements
in 1D and 3D modeling, NExT-Mol achieves a 26% relative improvement in 3D FCD
for de novo 3D generation on GEOM-DRUGS, and a 13% average relative gain for
conditional 3D generation on QM9-2014. Our codes and pretrained checkpoints are
available at https://github.com/acharkq/NExT-Mol.
67b6acdb3a3df2f965e7af0b
Zhiyuan Liu
admin_assigned
2025-02-20T17:43:04.070Z
6310a3cd531cc21f9e06de6a
https://cdn-avatars.huggingface.co/v1/production/uploads/6310a3cd531cc21f9e06de6a/aTGMx3O41lUARK9s3dAik.jpeg
Zhiyuan Liu
user
acharkq
67b6acdb3a3df2f965e7af0c
Yanchen Luo
claimed_verified
2025-02-21T09:59:48.054Z
64f04a28f3cd962c21726459
https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/MOTc7SWbzc4jdJbMcWMcK.jpeg
LuoYanchen
user
lyc0930
67b6acdb3a3df2f965e7af0d
Han Huang
67b6acdb3a3df2f965e7af0e
Enzhi Zhang
admin_assigned
2025-02-20T17:42:41.957Z
6522bdace3419abdcf8177f6
/avatars/872b22da6489959134b5449bb7ed9636.svg
EnzhiZhang
user
EnzhiZhang
67b6acdb3a3df2f965e7af0f
Sihang Li
67b6acdb3a3df2f965e7af10
Junfeng Fang
67b6acdb3a3df2f965e7af11
Yaorui Shi
admin_assigned
2025-02-20T17:42:26.270Z
63edd2d1f765928ceeb49057
https://cdn-avatars.huggingface.co/v1/production/uploads/1676530369930-noauth.png
Yaorui SHI
user
yrshi
67b6acdb3a3df2f965e7af12
Xiang Wang
extracted_pending
2025-02-20T04:17:33.860Z
65fca775fa59bdf4737b1a84
/avatars/a161b510bde8f57e7686cbb0b4aa6a52.svg
Xiang Wang
user
xiangwang1223
67b6acdb3a3df2f965e7af13
Kenji Kawaguchi
67b6acdb3a3df2f965e7af14
Tat-Seng Chua
admin_assigned
2025-02-20T17:42:12.905Z
6570ae84c4993b8fb96f41a8
/avatars/21f7d79d46ac4df0ecff8eca7678b33f.svg
Tat-Seng Chua
user
chuats
NExT-Mol: 3D Diffusion Meets 1D Language Modeling for 3D Molecule
  Generation
3D molecule generation is crucial for drug discovery and material design.
While prior efforts focus on 3D diffusion models for their benefits in modeling
continuous 3D conformers, they overlook the advantages of 1D SELFIES-based
Language Models (LMs), which can generate 100% valid molecules and leverage the
billion-scale 1D molecule datasets. To combine these advantages for 3D molecule
generation, we propose a foundation model -- NExT-Mol: 3D Diffusion Meets 1D
Language Modeling for 3D Molecule Generation. NExT-Mol uses an extensively
pretrained molecule LM for 1D molecule generation, and subsequently predicts
the generated molecule's 3D conformers with a 3D diffusion model. We enhance
NExT-Mol's performance by scaling up the LM's model size, refining the
diffusion neural architecture, and applying 1D to 3D transfer learning.
Notably, our 1D molecule LM significantly outperforms baselines in
distributional similarity while ensuring validity, and our 3D diffusion model
achieves leading performances in conformer prediction. Given these improvements
in 1D and 3D modeling, NExT-Mol achieves a 26% relative improvement in 3D FCD
for de novo 3D generation on GEOM-DRUGS, and a 13% average relative gain for
conditional 3D generation on QM9-2014. Our codes and pretrained checkpoints are
available at https://github.com/acharkq/NExT-Mol.
NExT-Mol combines 1D SELFIES-based language models and 3D diffusion models for accurate and valid 3D molecule generation, achieving significant improvements over baselines.
SELFIES-based Language Models 3D diffusion models NExT-Mol 3D conformers distributional similarity 3D FCD GEOM-DRUGS QM9-2014