title: Gaussian Frosting: Editable Complex Radiance Fields with Real-Time
    Rendering
summary: We propose Gaussian Frosting, a novel mesh-based representation for
  high-quality rendering and editing of complex 3D effects in real-time. Our
  approach builds on the recent 3D Gaussian Splatting framework, which optimizes
  a set of 3D Gaussians to approximate a radiance field from images. We propose
  first extracting a base mesh from Gaussians during optimization, then building
  and refining an adaptive layer of Gaussians with a variable thickness around
  the mesh to better capture the fine details and volumetric effects near the
  surface, such as hair or grass. We call this layer Gaussian Frosting, as it
  resembles a coating of frosting on a cake. The fuzzier the material, the
  thicker the frosting. We also introduce a parameterization of the Gaussians to
  enforce them to stay inside the frosting layer and automatically adjust their
  parameters when deforming, rescaling, editing or animating the mesh. Our
  representation allows for efficient rendering using Gaussian splatting, as well
  as editing and animation by modifying the base mesh. We demonstrate the
  effectiveness of our method on various synthetic and real scenes, and show that
  it outperforms existing surface-based approaches. We will release our code and
  a web-based viewer as additional contributions. Our project page is the
  following: https://anttwo.github.io/frosting/
paper_authors._id: 65fcf53b7a009ec44c145d48
paper_authors.name: Antoine Guédon
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2024-03-22T08:37:41.643Z
paper_authors._id: 6489dd894bbed6144c870274
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/6489dd894bbed6144c870274/c_J9b4DHwXeE5VtTeQ2ue.jpeg
paper_authors.fullname: Antoine Guédon
paper_authors.type: user
paper_authors.user: AntoineGuedon
paper_authors._id: 65fcf53b7a009ec44c145d49
paper_authors.name: Vincent Lepetit
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-03-22T10:20:18.653Z
paper_authors._id: 6353c6045eac2d2efa74a06f
paper_authors.avatarUrl: /avatars/b2102600513a08b3f96df4af53dcee98.svg
paper_authors.fullname: Vincent Lepetit
paper_authors.type: user
paper_authors.user: miettle
paper_title: Gaussian Frosting: Editable Complex Radiance Fields with Real-Time
    Rendering
paper_summary: We propose Gaussian Frosting, a novel mesh-based representation for
  high-quality rendering and editing of complex 3D effects in real-time. Our
  approach builds on the recent 3D Gaussian Splatting framework, which optimizes
  a set of 3D Gaussians to approximate a radiance field from images. We propose
  first extracting a base mesh from Gaussians during optimization, then building
  and refining an adaptive layer of Gaussians with a variable thickness around
  the mesh to better capture the fine details and volumetric effects near the
  surface, such as hair or grass. We call this layer Gaussian Frosting, as it
  resembles a coating of frosting on a cake. The fuzzier the material, the
  thicker the frosting. We also introduce a parameterization of the Gaussians to
  enforce them to stay inside the frosting layer and automatically adjust their
  parameters when deforming, rescaling, editing or animating the mesh. Our
  representation allows for efficient rendering using Gaussian splatting, as well
  as editing and animation by modifying the base mesh. We demonstrate the
  effectiveness of our method on various synthetic and real scenes, and show that
  it outperforms existing surface-based approaches. We will release our code and
  a web-based viewer as additional contributions. Our project page is the
  following: https://anttwo.github.io/frosting/
paper_ai_keywords: Gaussian Frosting Gaussian Splatting radiance field 3D Gaussians base mesh adaptive layer variable thickness volumetric effects fuzzy material parameterization Gaussian splatting surface-based approaches synthetic scenes real scenes