title: HeadStudio: Text to Animatable Head Avatars with 3D Gaussian Splatting
summary: Creating digital avatars from textual prompts has long been a desirable yet
  challenging task. Despite the promising outcomes obtained through 2D diffusion
  priors in recent works, current methods face challenges in achieving
  high-quality and animated avatars effectively. In this paper, we present
  HeadStudio, a novel framework that utilizes 3D Gaussian splatting to
  generate realistic and animated avatars from text prompts. Our method drives 3D
  Gaussians semantically to create a flexible and achievable appearance through
  the intermediate FLAME representation. Specifically, we incorporate the FLAME
  into both 3D representation and score distillation: 1) FLAME-based 3D Gaussian
  splatting, driving 3D Gaussian points by rigging each point to a FLAME mesh. 2)
  FLAME-based score distillation sampling, utilizing FLAME-based fine-grained
  control signal to guide score distillation from the text prompt. Extensive
  experiments demonstrate the efficacy of HeadStudio in generating animatable
  avatars from textual prompts, exhibiting visually appealing appearances. The
  avatars are capable of rendering high-quality real-time (geq 40 fps) novel
  views at a resolution of 1024. They can be smoothly controlled by real-world
  speech and video. We hope that HeadStudio can advance digital avatar creation
  and that the present method can widely be applied across various domains.
paper_authors._id: 65c98f15d908bd52a457b462
paper_authors.name: Zhenglin Zhou
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-02-12T16:15:42.140Z
paper_authors._id: 6425318d175bd2952281065e
paper_authors.avatarUrl: /avatars/37deb6ceb1552dece43a1c8c13c1c871.svg
paper_authors.fullname: ZhenglinZhou
paper_authors.type: user
paper_authors.user: zhenglin
paper_authors._id: 65c98f15d908bd52a457b463
paper_authors.name: Fan Ma
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-02-12T16:18:33.627Z
paper_authors._id: 652d3da8072563249e8c7824
paper_authors.avatarUrl: /avatars/9e24b3528774a4d7635c800b29a3588e.svg
paper_authors.fullname: Fan
paper_authors.type: user
paper_authors.user: Flowerfan
paper_authors._id: 65c98f15d908bd52a457b464
paper_authors.name: Hehe Fan
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-02-12T16:16:12.167Z
paper_authors._id: 64ad04020fb9b20dbabbd30e
paper_authors.avatarUrl: /avatars/a6bae4a3a4bcd6b54c33860fe14c7923.svg
paper_authors.fullname: Hehe Fan
paper_authors.type: user
paper_authors.user: hehefan
paper_authors._id: 65c98f15d908bd52a457b465
paper_authors.name: Yi Yang
paper_title: HeadStudio: Text to Animatable Head Avatars with 3D Gaussian Splatting
paper_summary: Creating digital avatars from textual prompts has long been a desirable yet
  challenging task. Despite the promising outcomes obtained through 2D diffusion
  priors in recent works, current methods face challenges in achieving
  high-quality and animated avatars effectively. In this paper, we present
  HeadStudio, a novel framework that utilizes 3D Gaussian splatting to
  generate realistic and animated avatars from text prompts. Our method drives 3D
  Gaussians semantically to create a flexible and achievable appearance through
  the intermediate FLAME representation. Specifically, we incorporate the FLAME
  into both 3D representation and score distillation: 1) FLAME-based 3D Gaussian
  splatting, driving 3D Gaussian points by rigging each point to a FLAME mesh. 2)
  FLAME-based score distillation sampling, utilizing FLAME-based fine-grained
  control signal to guide score distillation from the text prompt. Extensive
  experiments demonstrate the efficacy of HeadStudio in generating animatable
  avatars from textual prompts, exhibiting visually appealing appearances. The
  avatars are capable of rendering high-quality real-time (geq 40 fps) novel
  views at a resolution of 1024. They can be smoothly controlled by real-world
  speech and video. We hope that HeadStudio can advance digital avatar creation
  and that the present method can widely be applied across various domains.
paper_ai_summary: HeadStudio uses 3D Gaussian splatting and FLAME representation to generate high-quality, animated digital avatars from text prompts with real-time rendering capabilities.
paper_ai_keywords: Gaussian splatting FLAME score distillation rigging FLAME mesh real-time rendering avatars animated avatars textual prompts controlled by speech and video