DNA-Rendering: A Diverse Neural Actor Repository for High-Fidelity
  Human-centric Rendering
Realistic human-centric rendering plays a key role in both computer vision
and computer graphics. Rapid progress has been made in the algorithm aspect
over the years, yet existing human-centric rendering datasets and benchmarks
are rather impoverished in terms of diversity, which are crucial for rendering
effect. Researchers are usually constrained to explore and evaluate a small set
of rendering problems on current datasets, while real-world applications
require methods to be robust across different scenarios. In this work, we
present DNA-Rendering, a large-scale, high-fidelity repository of human
performance data for neural actor rendering. DNA-Rendering presents several
alluring attributes. First, our dataset contains over 1500 human subjects, 5000
motion sequences, and 67.5M frames' data volume. Second, we provide rich assets
for each subject -- 2D/3D human body keypoints, foreground masks, SMPLX models,
cloth/accessory materials, multi-view images, and videos. These assets boost
the current method's accuracy on downstream rendering tasks. Third, we
construct a professional multi-view system to capture data, which contains 60
synchronous cameras with max 4096 x 3000 resolution, 15 fps speed, and stern
camera calibration steps, ensuring high-quality resources for task training and
evaluation. Along with the dataset, we provide a large-scale and quantitative
benchmark in full-scale, with multiple tasks to evaluate the existing progress
of novel view synthesis, novel pose animation synthesis, and novel identity
rendering methods. In this manuscript, we describe our DNA-Rendering effort as
a revealing of new observations, challenges, and future directions to
human-centric rendering. The dataset, code, and benchmarks will be publicly
available at https://dna-rendering.github.io/
64b8b34aace99c0723a0d79d
Wei Cheng
claimed_verified
2023-07-20T14:13:52.585Z
64b914c8ace99c0723ad83a9
https://cdn-avatars.huggingface.co/v1/production/uploads/64b914c8ace99c0723ad83a9/B4gxNByeVY_xaOcjwiN1j.jpeg
Wei Cheng
user
wchengad
64b8b34aace99c0723a0d79e
Ruixiang Chen
claimed_verified
2023-07-27T12:28:56.494Z
64c25c0e400274d1299ee2e8
/avatars/17c7714260802bd612d2227a23f1f804.svg
Ruixiang Chen
user
louischen-007
64b8b34aace99c0723a0d79f
Wanqi Yin
claimed_verified
2025-02-27T09:18:55.937Z
668f51fb8e8d87dbdd23caa9
/avatars/0b17cb0f3ad2c729f185cdccdad94e48.svg
Yin
user
waanqii
64b8b34aace99c0723a0d7a0
Siming Fan
admin_assigned
2023-07-20T09:38:28.096Z
626b9a09f451470f861e1694
/avatars/9b8704a4c4ff5f3619b7e1e16dda3505.svg
Fan
user
Siming
64b8b34aace99c0723a0d7a1
Keyu Chen
64b8b34aace99c0723a0d7a2
Honglin He
admin_assigned
2023-07-20T09:39:49.259Z
647dd06b33493e1c4338c71d
/avatars/d20302e25ed8109ab48fa14858f62cdc.svg
Honglin He
user
Hollis-7
64b8b34aace99c0723a0d7a3
Huiwen Luo
64b8b34aace99c0723a0d7a4
Zhongang Cai
claimed_verified
2024-12-03T11:17:59.220Z
652d06833b5997ed71ce5c46
https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/xZTXEcnEogEmBm_ledJQr.jpeg
Zhongang Cai
user
caizhongang
64b8b34aace99c0723a0d7a5
Jingbo Wang
64b8b34aace99c0723a0d7a6
Yang Gao
admin_assigned
2023-07-20T09:40:40.581Z
6346b4e7fa79ac99a3ad12ee
/avatars/cf72b76a33c5779b049faf7bf6ec5070.svg
Yang Gao
user
gaoyang07
64b8b34aace99c0723a0d7a7
Zhengming Yu
64b8b34aace99c0723a0d7a8
Zhengyu Lin
64b8b34aace99c0723a0d7a9
Daxuan Ren
admin_assigned
2023-07-20T09:41:29.216Z
638d8ca09fd4474f0a27e88b
/avatars/7aae5e226e6b2656bc1936b56dbca8bb.svg
Ren
user
Daxuan
64b8b34aace99c0723a0d7aa
Lei Yang
admin_assigned
2025-03-10T08:12:30.199Z
6626a471430a124253f197c8
/avatars/f5747fdbe495d1296fed9d16d8c95857.svg
yl-1993
user
yl-1993
64b8b34aace99c0723a0d7ab
Ziwei Liu
admin_assigned
2023-07-20T09:42:16.334Z
62ab1ac1d48b4d8b048a3473
https://cdn-avatars.huggingface.co/v1/production/uploads/1656826685333-62ab1ac1d48b4d8b048a3473.png
Ziwei Liu
user
liuziwei7
64b8b34aace99c0723a0d7ac
Chen Change Loy
64b8b34aace99c0723a0d7ad
Chen Qian
64b8b34aace99c0723a0d7ae
Wayne Wu
claimed_verified
2023-07-20T14:13:46.664Z
64b93b383707b7d603d87521
/avatars/0a1280ca4646c35a6e433f53ba50ba61.svg
Wayne Wu
user
wywu
64b8b34aace99c0723a0d7af
Dahua Lin
admin_assigned
2023-07-20T09:43:59.957Z
636317ed80c1a705a6eff396
/avatars/3db090e101b916d9256d0d3e043db71d.svg
Dahua Lin
user
lindahua
64b8b34aace99c0723a0d7b0
Bo Dai
admin_assigned
2023-07-20T09:44:20.693Z
635f93577c05eb9f59966209
/avatars/add48d7e3790a6b500d6c451ef8b0f75.svg
Intelligent Digital Creation
user
BoDai
64b8b34aace99c0723a0d7b1
Kwan-Yee Lin
claimed_verified
2023-07-20T14:13:49.719Z
64b9226b25e5f8a3e0fc1bda
https://cdn-avatars.huggingface.co/v1/production/uploads/64b9226b25e5f8a3e0fc1bda/sU5ZN_a3VeTela--6sX5-.jpeg
Kwan-Yee Lin
user
KwanYee
DNA-Rendering: A Diverse Neural Actor Repository for High-Fidelity
  Human-centric Rendering
Realistic human-centric rendering plays a key role in both computer vision
and computer graphics. Rapid progress has been made in the algorithm aspect
over the years, yet existing human-centric rendering datasets and benchmarks
are rather impoverished in terms of diversity, which are crucial for rendering
effect. Researchers are usually constrained to explore and evaluate a small set
of rendering problems on current datasets, while real-world applications
require methods to be robust across different scenarios. In this work, we
present DNA-Rendering, a large-scale, high-fidelity repository of human
performance data for neural actor rendering. DNA-Rendering presents several
alluring attributes. First, our dataset contains over 1500 human subjects, 5000
motion sequences, and 67.5M frames' data volume. Second, we provide rich assets
for each subject -- 2D/3D human body keypoints, foreground masks, SMPLX models,
cloth/accessory materials, multi-view images, and videos. These assets boost
the current method's accuracy on downstream rendering tasks. Third, we
construct a professional multi-view system to capture data, which contains 60
synchronous cameras with max 4096 x 3000 resolution, 15 fps speed, and stern
camera calibration steps, ensuring high-quality resources for task training and
evaluation. Along with the dataset, we provide a large-scale and quantitative
benchmark in full-scale, with multiple tasks to evaluate the existing progress
of novel view synthesis, novel pose animation synthesis, and novel identity
rendering methods. In this manuscript, we describe our DNA-Rendering effort as
a revealing of new observations, challenges, and future directions to
human-centric rendering. The dataset, code, and benchmarks will be publicly
available at https://dna-rendering.github.io/
DNA-Rendering is a comprehensive dataset of human performance data that enhances neural actor rendering accuracy by providing diverse assets and a professional multi-view capture system.
neural actor rendering SMPLX novel view synthesis novel pose animation synthesis novel identity rendering multi-view images videos camera calibration