title: FlexPainter: Flexible and Multi-View Consistent Texture Generation
summary: Texture map production is an important part of 3D modeling and determines the
  rendering quality. Recently, diffusion-based methods have opened a new way for
  texture generation. However, restricted control flexibility and limited prompt
  modalities may prevent creators from producing desired results. Furthermore,
  inconsistencies between generated multi-view images often lead to poor texture
  generation quality. To address these issues, we introduce FlexPainter,
  a novel texture generation pipeline that enables flexible multi-modal
  conditional guidance and achieves highly consistent texture generation. A
  shared conditional embedding space is constructed to perform flexible
  aggregation between different input modalities. Utilizing such embedding space,
  we present an image-based CFG method to decompose structural and style
  information, achieving reference image-based stylization. Leveraging the 3D
  knowledge within the image diffusion prior, we first generate multi-view images
  simultaneously using a grid representation to enhance global understanding.
  Meanwhile, we propose a view synchronization and adaptive weighting module
  during diffusion sampling to further ensure local consistency. Finally, a
  3D-aware texture completion model combined with a texture enhancement model is
  used to generate seamless, high-resolution texture maps. Comprehensive
  experiments demonstrate that our framework significantly outperforms
  state-of-the-art methods in both flexibility and generation quality.
paper_authors._id: 68425ef33b5bb39c456487e0
paper_authors.name: Dongyu Yan
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2025-06-06T07:40:56.223Z
paper_authors._id: 64049ae20ab5e22719f35103
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/1678023295407-noauth.jpeg
paper_authors.fullname: Dongyu Yan
paper_authors.type: user
paper_authors.user: StarYDY
paper_authors._id: 68425ef33b5bb39c456487e1
paper_authors.name: Leyi Wu
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2025-06-07T13:33:56.360Z
paper_authors._id: 6622f3e1c80be2cc569fb5e1
paper_authors.avatarUrl: /avatars/f4bacc6e090ec6e6d9f89b279783f1bd.svg
paper_authors.fullname: LeyiWu
paper_authors.type: user
paper_authors.user: YUEVII
paper_authors._id: 68425ef33b5bb39c456487e2
paper_authors.name: Jiantao Lin
paper_authors._id: 68425ef33b5bb39c456487e3
paper_authors.name: Luozhou Wang
paper_authors._id: 68425ef33b5bb39c456487e4
paper_authors.name: Tianshuo Xu
paper_authors._id: 68425ef33b5bb39c456487e5
paper_authors.name: Zhifei Chen
paper_authors._id: 68425ef33b5bb39c456487e6
paper_authors.name: Zhen Yang
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2025-06-07T05:48:51.341Z
paper_authors._id: 63f58403fcf95ecac2b33d78
paper_authors.avatarUrl: /avatars/a77ea80784896502ae1cfa086a78ce66.svg
paper_authors.fullname: Zhen Yang
paper_authors.type: user
paper_authors.user: YZCS
paper_authors._id: 68425ef33b5bb39c456487e7
paper_authors.name: Lie Xu
paper_authors._id: 68425ef33b5bb39c456487e8
paper_authors.name: Shunsi Zhang
paper_authors._id: 68425ef33b5bb39c456487e9
paper_authors.name: Yingcong Chen
paper_authors.status: extracted_pending
paper_authors.statusLastChangedAt: 2025-06-06T03:22:29.750Z
paper_authors._id: 655cba1d87b67834000590e8
paper_authors.avatarUrl: /avatars/3bd43b7c9351f65b8f38f4c8237a0146.svg
paper_authors.fullname: Yingcong Chen
paper_authors.type: user
paper_authors.user: yingcongchen
paper_title: FlexPainter: Flexible and Multi-View Consistent Texture Generation
paper_summary: Texture map production is an important part of 3D modeling and determines the
  rendering quality. Recently, diffusion-based methods have opened a new way for
  texture generation. However, restricted control flexibility and limited prompt
  modalities may prevent creators from producing desired results. Furthermore,
  inconsistencies between generated multi-view images often lead to poor texture
  generation quality. To address these issues, we introduce FlexPainter,
  a novel texture generation pipeline that enables flexible multi-modal
  conditional guidance and achieves highly consistent texture generation. A
  shared conditional embedding space is constructed to perform flexible
  aggregation between different input modalities. Utilizing such embedding space,
  we present an image-based CFG method to decompose structural and style
  information, achieving reference image-based stylization. Leveraging the 3D
  knowledge within the image diffusion prior, we first generate multi-view images
  simultaneously using a grid representation to enhance global understanding.
  Meanwhile, we propose a view synchronization and adaptive weighting module
  during diffusion sampling to further ensure local consistency. Finally, a
  3D-aware texture completion model combined with a texture enhancement model is
  used to generate seamless, high-resolution texture maps. Comprehensive
  experiments demonstrate that our framework significantly outperforms
  state-of-the-art methods in both flexibility and generation quality.
paper_ai_summary: FlexPainter, a novel texture generation pipeline, uses a shared conditional embedding space to enable flexible multi-modal guidance, ensuring high-quality and consistent texture map generation using image diffusion priors and a 3D-aware model.
paper_ai_keywords: diffusion-based methods texture generation flexible multi-modal conditional guidance conditional embedding space image-based CFG method structural information style information reference image-based stylization image diffusion prior grid representation view synchronization adaptive weighting module 3D-aware texture completion model texture enhancement model