title: PicoAudio: Enabling Precise Timestamp and Frequency Controllability of
    Audio Events in Text-to-audio Generation
summary: Recently, audio generation tasks have attracted considerable research
  interests. Precise temporal controllability is essential to integrate audio
  generation with real applications. In this work, we propose a temporal
  controlled audio generation framework, PicoAudio. PicoAudio integrates temporal
  information to guide audio generation through tailored model design. It
  leverages data crawling, segmentation, filtering, and simulation of
  fine-grained temporally-aligned audio-text data. Both subjective and objective
  evaluations demonstrate that PicoAudio dramantically surpasses current
  state-of-the-art generation models in terms of timestamp and occurrence
  frequency controllability. The generated samples are available on the demo
  website https://PicoAudio.github.io.
paper_authors._id: 668639f8b9a71fa518a628bd
paper_authors.name: Zeyu Xie
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2024-07-05T06:55:15.541Z
paper_authors._id: 64ca3251710645aa7bd1ccdc
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/64ca3251710645aa7bd1ccdc/iQV8f8gU220ECxIkTkea0.jpeg
paper_authors.fullname: Zeyu Xie
paper_authors.type: user
paper_authors.user: ZeyuXie
paper_authors._id: 668639f8b9a71fa518a628be
paper_authors.name: Xuenan Xu
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-07-04T12:17:06.950Z
paper_authors._id: 6457623c90bf61c87f9ffdc4
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/6457623c90bf61c87f9ffdc4/pKG76YipWfYFhSnorepsl.jpeg
paper_authors.fullname: Xuenan Xu
paper_authors.type: user
paper_authors.user: wsntxxn
paper_authors._id: 668639f8b9a71fa518a628bf
paper_authors.name: Zhizheng Wu
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2024-07-05T06:55:39.445Z
paper_authors._id: 63b4dcefa50cfcefdaa121f3
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/63b4dcefa50cfcefdaa121f3/MlIxOaTSCbZARVyo8Ly7r.jpeg
paper_authors.fullname: Dr Wuz
paper_authors.type: user
paper_authors.user: drwuz
paper_authors._id: 668639f8b9a71fa518a628c0
paper_authors.name: Mengyue Wu
paper_title: PicoAudio: Enabling Precise Timestamp and Frequency Controllability of
    Audio Events in Text-to-audio Generation
paper_summary: Recently, audio generation tasks have attracted considerable research
  interests. Precise temporal controllability is essential to integrate audio
  generation with real applications. In this work, we propose a temporal
  controlled audio generation framework, PicoAudio. PicoAudio integrates temporal
  information to guide audio generation through tailored model design. It
  leverages data crawling, segmentation, filtering, and simulation of
  fine-grained temporally-aligned audio-text data. Both subjective and objective
  evaluations demonstrate that PicoAudio dramantically surpasses current
  state-of-the-art generation models in terms of timestamp and occurrence
  frequency controllability. The generated samples are available on the demo
  website https://PicoAudio.github.io.
paper_ai_keywords: audio generation temporal controllability model design data crawling segmentation filtering simulation fine-grained temporally-aligned audio-text data timestamp controllability occurrence frequency controllability subjective evaluations objective evaluations state-of-the-art generation models