title: Seed-Music: A Unified Framework for High Quality and Controlled Music
    Generation
summary: We introduce Seed-Music, a suite of music generation systems capable of
  producing high-quality music with fine-grained style control. Our unified
  framework leverages both auto-regressive language modeling and diffusion
  approaches to support two key music creation workflows: controlled
  music generation and post-production editing. For controlled music
  generation, our system enables vocal music generation with performance controls
  from multi-modal inputs, including style descriptions, audio references,
  musical scores, and voice prompts. For post-production editing, it offers
  interactive tools for editing lyrics and vocal melodies directly in the
  generated audio.
    We encourage readers to listen to demo audio examples at
  https://team.doubao.com/seed-music .
paper_authors._id: 66e8f414cd955ad711aa021d
paper_authors.name: Ye Bai
paper_authors._id: 66e8f414cd955ad711aa021e
paper_authors.name: Haonan Chen
paper_authors._id: 66e8f414cd955ad711aa021f
paper_authors.name: Jitong Chen
paper_authors._id: 66e8f414cd955ad711aa0220
paper_authors.name: Zhuo Chen
paper_authors._id: 66e8f414cd955ad711aa0221
paper_authors.name: Yi Deng
paper_authors._id: 66e8f414cd955ad711aa0222
paper_authors.name: Xiaohong Dong
paper_authors._id: 66e8f414cd955ad711aa0223
paper_authors.name: Lamtharn Hantrakul
paper_authors._id: 66e8f414cd955ad711aa0224
paper_authors.name: Weituo Hao
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-09-17T07:29:17.750Z
paper_authors._id: 62fd76854723285c5e16562e
paper_authors.avatarUrl: /avatars/792bb34fbde9a3f1614946cdb8d2d62d.svg
paper_authors.fullname: Hao
paper_authors.type: user
paper_authors.user: Weituo
paper_authors._id: 66e8f414cd955ad711aa0225
paper_authors.name: Qingqing Huang
paper_authors._id: 66e8f414cd955ad711aa0226
paper_authors.name: Zhongyi Huang
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-09-17T07:28:59.692Z
paper_authors._id: 6460ec941db65f8785148710
paper_authors.avatarUrl: /avatars/4b5c9dc17cd8f038bb99317f80c52c0e.svg
paper_authors.fullname: huangzhongyi
paper_authors.type: user
paper_authors.user: smileezzz
paper_authors._id: 66e8f414cd955ad711aa0227
paper_authors.name: Dongya Jia
paper_authors._id: 66e8f414cd955ad711aa0228
paper_authors.name: Feihu La
paper_authors._id: 66e8f414cd955ad711aa0229
paper_authors.name: Duc Le
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-09-17T07:30:29.776Z
paper_authors._id: 645cf0d401f4eaab2a071099
paper_authors.avatarUrl: /avatars/619706a56c79498768b2d9965074b49c.svg
paper_authors.fullname: Duc Le
paper_authors.type: user
paper_authors.user: ducle
paper_authors._id: 66e8f414cd955ad711aa022a
paper_authors.name: Bochen Li
paper_authors._id: 66e8f414cd955ad711aa022b
paper_authors.name: Chumin Li
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-09-17T07:31:02.839Z
paper_authors._id: 64355a3bf81a16e743614ea5
paper_authors.avatarUrl: /avatars/9104a301a17f77f7544a079f9b167853.svg
paper_authors.fullname: lichuming
paper_authors.type: user
paper_authors.user: lich-ming
paper_authors._id: 66e8f414cd955ad711aa022c
paper_authors.name: Hui Li
paper_authors._id: 66e8f414cd955ad711aa022d
paper_authors.name: Xingxing Li
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-09-17T07:31:22.114Z
paper_authors._id: 644686ea21eff8427f78a0b9
paper_authors.avatarUrl: /avatars/3d20c70324c567150473c95a74b92cb7.svg
paper_authors.fullname: li
paper_authors.type: user
paper_authors.user: lixingxing
paper_authors._id: 66e8f414cd955ad711aa022e
paper_authors.name: Shouda Liu
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-09-17T07:35:12.239Z
paper_authors._id: 65db1dd1ab2f64915ceb6bfc
paper_authors.avatarUrl: /avatars/6c9c54ca7de453555df498ff26e85079.svg
paper_authors.fullname: liushouda
paper_authors.type: user
paper_authors.user: vsooda
paper_authors._id: 66e8f414cd955ad711aa022f
paper_authors.name: Wei-Tsung Lu
paper_authors._id: 66e8f414cd955ad711aa0230
paper_authors.name: Yiqing Lu
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2024-11-29T10:08:34.483Z
paper_authors._id: 67497ded74956f2e97f80bb0
paper_authors.avatarUrl: /avatars/489ef536f0c6c901de777a765b8f1a44.svg
paper_authors.fullname: yiqing lu
paper_authors.type: user
paper_authors.user: yiqing5
paper_authors._id: 66e8f414cd955ad711aa0231
paper_authors.name: Andrew Shaw
paper_authors._id: 66e8f414cd955ad711aa0232
paper_authors.name: Janne Spijkervet
paper_authors._id: 66e8f414cd955ad711aa0233
paper_authors.name: Yakun Sun
paper_authors._id: 66e8f414cd955ad711aa0234
paper_authors.name: Bo Wang
paper_authors._id: 66e8f414cd955ad711aa0235
paper_authors.name: Ju-Chiang Wang
paper_authors._id: 66e8f414cd955ad711aa0236
paper_authors.name: Yuping Wang
paper_authors._id: 66e8f414cd955ad711aa0237
paper_authors.name: Yuxuan Wang
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-09-17T07:32:12.188Z
paper_authors._id: 6694e5344a34b68738070c07
paper_authors.avatarUrl: /avatars/f33ec08ec9822bb353020000a2fcbd84.svg
paper_authors.fullname: Yuxuan WANG
paper_authors.type: user
paper_authors.user: AlbusYuxuanWang
paper_authors._id: 66e8f414cd955ad711aa0238
paper_authors.name: Ling Xu
paper_authors._id: 66e8f414cd955ad711aa0239
paper_authors.name: Yifeng Yang
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-09-17T07:34:06.836Z
paper_authors._id: 66541f311b1ce9f4a6c8e7a6
paper_authors.avatarUrl: /avatars/1062a9887325c426863afa05620a81f8.svg
paper_authors.fullname: YIFENG YANG
paper_authors.type: user
paper_authors.user: cnyangyifeng
paper_authors._id: 66e8f414cd955ad711aa023a
paper_authors.name: Chao Yao
paper_authors._id: 66e8f414cd955ad711aa023b
paper_authors.name: Shuo Zhang
paper_authors._id: 66e8f414cd955ad711aa023c
paper_authors.name: Yang Zhang
paper_authors._id: 66e8f414cd955ad711aa023d
paper_authors.name: Yilin Zhang
paper_authors._id: 66e8f414cd955ad711aa023e
paper_authors.name: Hang Zhao
paper_authors._id: 66e8f414cd955ad711aa023f
paper_authors.name: Ziyi Zhao
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-09-17T07:33:34.131Z
paper_authors._id: 65d590ac493aeaf0bb5b3443
paper_authors.avatarUrl: /avatars/6b1cc5c1a50571c8ecccb56832e768f9.svg
paper_authors.fullname: Ziyi Zhao
paper_authors.type: user
paper_authors.user: Ziyi98
paper_authors._id: 66e8f414cd955ad711aa0240
paper_authors.name: Dejian Zhong
paper_authors._id: 66e8f414cd955ad711aa0241
paper_authors.name: Shicen Zhou
paper_authors._id: 66e8f414cd955ad711aa0242
paper_authors.name: Pei Zou
paper_title: Seed-Music: A Unified Framework for High Quality and Controlled Music
    Generation
paper_summary: We introduce Seed-Music, a suite of music generation systems capable of
  producing high-quality music with fine-grained style control. Our unified
  framework leverages both auto-regressive language modeling and diffusion
  approaches to support two key music creation workflows: controlled
  music generation and post-production editing. For controlled music
  generation, our system enables vocal music generation with performance controls
  from multi-modal inputs, including style descriptions, audio references,
  musical scores, and voice prompts. For post-production editing, it offers
  interactive tools for editing lyrics and vocal melodies directly in the
  generated audio.
    We encourage readers to listen to demo audio examples at
  https://team.doubao.com/seed-music .
paper_ai_keywords: auto-regressive language modeling diffusion approaches controlled music generation post-production editing vocal music generation multi-modal inputs style descriptions audio references musical scores voice prompts interactive tools