Flexible Isosurface Extraction for Gradient-Based Mesh Optimization
This work considers gradient-based mesh optimization, where we iteratively
optimize for a 3D surface mesh by representing it as the isosurface of a scalar
field, an increasingly common paradigm in applications including
photogrammetry, generative modeling, and inverse physics. Existing
implementations adapt classic isosurface extraction algorithms like Marching
Cubes or Dual Contouring; these techniques were designed to extract meshes from
fixed, known fields, and in the optimization setting they lack the degrees of
freedom to represent high-quality feature-preserving meshes, or suffer from
numerical instabilities. We introduce FlexiCubes, an isosurface representation
specifically designed for optimizing an unknown mesh with respect to geometric,
visual, or even physical objectives. Our main insight is to introduce
additional carefully-chosen parameters into the representation, which allow
local flexible adjustments to the extracted mesh geometry and connectivity.
These parameters are updated along with the underlying scalar field via
automatic differentiation when optimizing for a downstream task. We base our
extraction scheme on Dual Marching Cubes for improved topological properties,
and present extensions to optionally generate tetrahedral and
hierarchically-adaptive meshes. Extensive experiments validate FlexiCubes on
both synthetic benchmarks and real-world applications, showing that it offers
significant improvements in mesh quality and geometric fidelity.
64d5a750505306fcd2a03332
Tianchang Shen
64d5a750505306fcd2a03333
Jacob Munkberg
64d5a750505306fcd2a03334
Jon Hasselgren
64d5a750505306fcd2a03335
Kangxue Yin
64d5a750505306fcd2a03336
Zian Wang
64d5a750505306fcd2a03337
Wenzheng Chen
64d5a750505306fcd2a03338
Zan Gojcic
claimed_verified
2025-03-26T20:51:03.253Z
6366cda3361a96184dc22139
/avatars/d8a88c84cb5f69e69dd038674a29be89.svg
Zan Gojcic
user
zgojcic
64d5a750505306fcd2a03339
Sanja Fidler
64d5a750505306fcd2a0333a
Nicholas Sharp
64d5a750505306fcd2a0333b
Jun Gao
Flexible Isosurface Extraction for Gradient-Based Mesh Optimization
This work considers gradient-based mesh optimization, where we iteratively
optimize for a 3D surface mesh by representing it as the isosurface of a scalar
field, an increasingly common paradigm in applications including
photogrammetry, generative modeling, and inverse physics. Existing
implementations adapt classic isosurface extraction algorithms like Marching
Cubes or Dual Contouring; these techniques were designed to extract meshes from
fixed, known fields, and in the optimization setting they lack the degrees of
freedom to represent high-quality feature-preserving meshes, or suffer from
numerical instabilities. We introduce FlexiCubes, an isosurface representation
specifically designed for optimizing an unknown mesh with respect to geometric,
visual, or even physical objectives. Our main insight is to introduce
additional carefully-chosen parameters into the representation, which allow
local flexible adjustments to the extracted mesh geometry and connectivity.
These parameters are updated along with the underlying scalar field via
automatic differentiation when optimizing for a downstream task. We base our
extraction scheme on Dual Marching Cubes for improved topological properties,
and present extensions to optionally generate tetrahedral and
hierarchically-adaptive meshes. Extensive experiments validate FlexiCubes on
both synthetic benchmarks and real-world applications, showing that it offers
significant improvements in mesh quality and geometric fidelity.
FlexiCubes improves mesh quality and fidelity in optimization by introducing flexible parameters into the Dual Marching Cubes scheme.
gradient-based mesh optimization isosurface of a scalar field Marching Cubes Dual Contouring FlexiCubes automatic differentiation Dual Marching Cubes tetrahedral meshes hierarchically-adaptive meshes