title: Acoustic Volume Rendering for Neural Impulse Response Fields
summary: Realistic audio synthesis that captures accurate acoustic phenomena is
  essential for creating immersive experiences in virtual and augmented reality.
  Synthesizing the sound received at any position relies on the estimation of
  impulse response (IR), which characterizes how sound propagates in one scene
  along different paths before arriving at the listener's position. In this
  paper, we present Acoustic Volume Rendering (AVR), a novel approach that adapts
  volume rendering techniques to model acoustic impulse responses. While volume
  rendering has been successful in modeling radiance fields for images and neural
  scene representations, IRs present unique challenges as time-series signals. To
  address these challenges, we introduce frequency-domain volume rendering and
  use spherical integration to fit the IR measurements. Our method constructs an
  impulse response field that inherently encodes wave propagation principles and
  achieves state-of-the-art performance in synthesizing impulse responses for
  novel poses. Experiments show that AVR surpasses current leading methods by a
  substantial margin. Additionally, we develop an acoustic simulation platform,
  AcoustiX, which provides more accurate and realistic IR simulations than
  existing simulators. Code for AVR and AcoustiX are available at
  https://zitonglan.github.io/avr.
paper_authors._id: 6732bbb96c671fb849ad965a
paper_authors.name: Zitong Lan
paper_authors._id: 6732bbb96c671fb849ad965b
paper_authors.name: Chenhao Zheng
paper_authors._id: 6732bbb96c671fb849ad965c
paper_authors.name: Zhiwei Zheng
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-11-13T16:56:01.507Z
paper_authors._id: 6340e9c67158d417a0fdb0c5
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/OeRx05yiLURO_uUx0AYux.png
paper_authors.fullname: Zhiwei
paper_authors.type: user
paper_authors.user: zzwalala
paper_authors._id: 6732bbb96c671fb849ad965d
paper_authors.name: Mingmin Zhao
paper_title: Acoustic Volume Rendering for Neural Impulse Response Fields
paper_summary: Realistic audio synthesis that captures accurate acoustic phenomena is
  essential for creating immersive experiences in virtual and augmented reality.
  Synthesizing the sound received at any position relies on the estimation of
  impulse response (IR), which characterizes how sound propagates in one scene
  along different paths before arriving at the listener's position. In this
  paper, we present Acoustic Volume Rendering (AVR), a novel approach that adapts
  volume rendering techniques to model acoustic impulse responses. While volume
  rendering has been successful in modeling radiance fields for images and neural
  scene representations, IRs present unique challenges as time-series signals. To
  address these challenges, we introduce frequency-domain volume rendering and
  use spherical integration to fit the IR measurements. Our method constructs an
  impulse response field that inherently encodes wave propagation principles and
  achieves state-of-the-art performance in synthesizing impulse responses for
  novel poses. Experiments show that AVR surpasses current leading methods by a
  substantial margin. Additionally, we develop an acoustic simulation platform,
  AcoustiX, which provides more accurate and realistic IR simulations than
  existing simulators. Code for AVR and AcoustiX are available at
  https://zitonglan.github.io/avr.
paper_ai_keywords: Acoustic Volume Rendering (AVR) Impulse Response (IR) frequency-domain volume rendering spherical harmonic Rendering impulse response field wave propagation principles AcoustiX state-of-the-art performance iterative methods