title: Facing the Music: Tackling Singing Voice Separation in Cinematic Audio
    Source Separation
summary: Cinematic audio source separation (CASS) is a fairly new subtask of audio
  source separation. A typical setup of CASS is a three-stem problem, with the
  aim of separating the mixture into the dialogue stem (DX), music stem (MX), and
  effects stem (FX). In practice, however, several edge cases exist as some sound
  sources do not fit neatly in either of these three stems, necessitating the use
  of additional auxiliary stems in production. One very common edge case is the
  singing voice in film audio, which may belong in either the DX or MX, depending
  heavily on the cinematic context. In this work, we demonstrate a very
  straightforward extension of the dedicated-decoder Bandit and query-based
  single-decoder Banquet models to a four-stem problem, treating non-musical
  dialogue, instrumental music, singing voice, and effects as separate stems.
  Interestingly, the query-based Banquet model outperformed the dedicated-decoder
  Bandit model. We hypothesized that this is due to a better feature alignment at
  the bottleneck as enforced by the band-agnostic FiLM layer. Dataset and model
  implementation will be made available at
  https://github.com/kwatcharasupat/source-separation-landing.
paper_authors._id: 66b4369e8a1be1e8acc7fb17
paper_authors.name: Karn N. Watcharasupat
paper_authors.status: extracted_confirmed
paper_authors.statusLastChangedAt: 2024-08-08T18:33:31.743Z
paper_authors._id: 66473a146fa6cf6e541d946d
paper_authors.avatarUrl: /avatars/ba8948fbaecc89d7d8ef59416cf9eb9d.svg
paper_authors.fullname: Karn Watcharasupat
paper_authors.type: user
paper_authors.user: kwatcharasupat
paper_authors._id: 66b4369e8a1be1e8acc7fb18
paper_authors.name: Chih-Wei Wu
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-08-08T10:50:32.609Z
paper_authors._id: 664be5ee0f633df0c13e78d3
paper_authors.avatarUrl: /avatars/f8c8add031febe32212717fc7dfeae5f.svg
paper_authors.fullname: Chih-Wei Wu
paper_authors.type: user
paper_authors.user: cwu307
paper_authors._id: 66b4369e8a1be1e8acc7fb19
paper_authors.name: Iroro Orife
paper_title: Facing the Music: Tackling Singing Voice Separation in Cinematic Audio
    Source Separation
paper_summary: Cinematic audio source separation (CASS) is a fairly new subtask of audio
  source separation. A typical setup of CASS is a three-stem problem, with the
  aim of separating the mixture into the dialogue stem (DX), music stem (MX), and
  effects stem (FX). In practice, however, several edge cases exist as some sound
  sources do not fit neatly in either of these three stems, necessitating the use
  of additional auxiliary stems in production. One very common edge case is the
  singing voice in film audio, which may belong in either the DX or MX, depending
  heavily on the cinematic context. In this work, we demonstrate a very
  straightforward extension of the dedicated-decoder Bandit and query-based
  single-decoder Banquet models to a four-stem problem, treating non-musical
  dialogue, instrumental music, singing voice, and effects as separate stems.
  Interestingly, the query-based Banquet model outperformed the dedicated-decoder
  Bandit model. We hypothesized that this is due to a better feature alignment at
  the bottleneck as enforced by the band-agnostic FiLM layer. Dataset and model
  implementation will be made available at
  https://github.com/kwatcharasupat/source-separation-landing.
paper_ai_summary: The query-based Banquet model outperforms the dedicated-decoder Bandit model in a four-stem Cinematic Audio Source Separation task by better aligning features through a band-agnostic FiLM layer.
paper_ai_keywords: Bandit Banquet FiLM layer Cinematic Audio Source Separation CASS four-stem problem dialogue stem music stem effects stem singing voice