PicoAudio: Enabling Precise Timestamp and Frequency Controllability of
  Audio Events in Text-to-audio Generation
Recently, audio generation tasks have attracted considerable research
interests. Precise temporal controllability is essential to integrate audio
generation with real applications. In this work, we propose a temporal
controlled audio generation framework, PicoAudio. PicoAudio integrates temporal
information to guide audio generation through tailored model design. It
leverages data crawling, segmentation, filtering, and simulation of
fine-grained temporally-aligned audio-text data. Both subjective and objective
evaluations demonstrate that PicoAudio dramantically surpasses current
state-of-the-art generation models in terms of timestamp and occurrence
frequency controllability. The generated samples are available on the demo
website https://PicoAudio.github.io.
668639f8b9a71fa518a628bd
Zeyu Xie
claimed_verified
2024-07-05T06:55:15.541Z
64ca3251710645aa7bd1ccdc
https://cdn-avatars.huggingface.co/v1/production/uploads/64ca3251710645aa7bd1ccdc/iQV8f8gU220ECxIkTkea0.jpeg
Zeyu Xie
user
ZeyuXie
668639f8b9a71fa518a628be
Xuenan Xu
admin_assigned
2024-07-04T12:17:06.950Z
6457623c90bf61c87f9ffdc4
https://cdn-avatars.huggingface.co/v1/production/uploads/6457623c90bf61c87f9ffdc4/pKG76YipWfYFhSnorepsl.jpeg
Xuenan Xu
user
wsntxxn
668639f8b9a71fa518a628bf
Zhizheng Wu
claimed_verified
2024-07-05T06:55:39.445Z
63b4dcefa50cfcefdaa121f3
https://cdn-avatars.huggingface.co/v1/production/uploads/63b4dcefa50cfcefdaa121f3/MlIxOaTSCbZARVyo8Ly7r.jpeg
Dr Wuz
user
drwuz
668639f8b9a71fa518a628c0
Mengyue Wu
PicoAudio: Enabling Precise Timestamp and Frequency Controllability of
  Audio Events in Text-to-audio Generation
Recently, audio generation tasks have attracted considerable research
interests. Precise temporal controllability is essential to integrate audio
generation with real applications. In this work, we propose a temporal
controlled audio generation framework, PicoAudio. PicoAudio integrates temporal
information to guide audio generation through tailored model design. It
leverages data crawling, segmentation, filtering, and simulation of
fine-grained temporally-aligned audio-text data. Both subjective and objective
evaluations demonstrate that PicoAudio dramantically surpasses current
state-of-the-art generation models in terms of timestamp and occurrence
frequency controllability. The generated samples are available on the demo
website https://PicoAudio.github.io.
PicoAudio, a temporal-controlled audio generation framework, enhances timestamp and occurrence frequency controllability through tailored model design and fine-grained audio-text data.
temporal controllability audio generation framework temporal information data crawling segmentation filtering simulation fine-grained temporally-aligned audio-text data