title: Amphion: An Open-Source Audio, Music and Speech Generation Toolkit
summary: Amphion is a toolkit for Audio, Music, and Speech Generation. Its purpose is
  to support reproducible research and help junior researchers and engineers get
  started in the field of audio, music, and speech generation research and
  development. Amphion offers a unique feature: visualizations of classic models
  or architectures. We believe that these visualizations are beneficial for
  junior researchers and engineers who wish to gain a better understanding of the
  model. The North-Star objective of Amphion is to offer a platform for studying
  the conversion of any inputs into general audio. Amphion is designed to support
  individual generation tasks. In addition to the specific generation tasks,
  Amphion also includes several vocoders and evaluation metrics. A vocoder is an
  important module for producing high-quality audio signals, while evaluation
  metrics are critical for ensuring consistent metrics in generation tasks. In
  this paper, we provide a high-level overview of Amphion.
paper_authors._id: 657fd182c7cb69069abc3748
paper_authors.name: Xueyao Zhang
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2023-12-18T08:47:33.064Z
paper_authors._id: 60486b2cec955c4994bb6249
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/60486b2cec955c4994bb6249/qNHSGbTA7svVWEO3BI3M7.jpeg
paper_authors.fullname: Xueyao Zhang
paper_authors.type: user
paper_authors.user: RMSnow
paper_authors._id: 657fd182c7cb69069abc3749
paper_authors.name: Liumeng Xue
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2023-12-18T08:49:52.539Z
paper_authors._id: 6290e961473e457463a53248
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/6290e961473e457463a53248/-58Dp5uHvdjs9yOupAMs0.jpeg
paper_authors.fullname: Liumeng Xue
paper_authors.type: user
paper_authors.user: lmxue
paper_authors._id: 657fd182c7cb69069abc374a
paper_authors.name: Yuancheng Wang
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2023-12-18T08:50:12.902Z
paper_authors._id: 6539cc2d48b006575d3f5da2
paper_authors.avatarUrl: /avatars/a2ac1973800e8bb6a72e35fefb436a27.svg
paper_authors.fullname: wangyuancheng
paper_authors.type: user
paper_authors.user: CXKyyds199
paper_authors._id: 657fd182c7cb69069abc374b
paper_authors.name: Yicheng Gu
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2024-02-16T08:36:27.660Z
paper_authors._id: 656eb03d228bbe9eb46f163d
paper_authors.avatarUrl: /avatars/47b75f913a40e22f178b62eaea5272d4.svg
paper_authors.fullname: YichengGu
paper_authors.type: user
paper_authors.user: Setsugesuka
paper_authors._id: 657fd182c7cb69069abc374c
paper_authors.name: Xi Chen
paper_authors._id: 657fd182c7cb69069abc374d
paper_authors.name: Zihao Fang
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2023-12-20T09:54:27.004Z
paper_authors._id: 6580349d9aee950d4a8aa134
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/cMXAUckwqGm01K28Oxb1w.png
paper_authors.fullname: Zihao Fang
paper_authors.type: user
paper_authors.user: WelkinFang
paper_authors._id: 657fd182c7cb69069abc374e
paper_authors.name: Haopeng Chen
paper_authors._id: 657fd182c7cb69069abc374f
paper_authors.name: Lexiao Zou
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2023-12-18T08:51:08.410Z
paper_authors._id: 656558f04914c4787126edf6
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/656558f04914c4787126edf6/EEO8t_qbTtvDymuAx8NFe.jpeg
paper_authors.fullname: Zou Lexiao
paper_authors.type: user
paper_authors.user: Lokshaw
paper_authors._id: 657fd182c7cb69069abc3750
paper_authors.name: Chaoren Wang
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2023-12-18T08:51:18.827Z
paper_authors._id: 649934bebe8a8211291ac9b5
paper_authors.avatarUrl: /avatars/7df445dee65329b3569c818381c388d9.svg
paper_authors.fullname: wang
paper_authors.type: user
paper_authors.user: chaoren1937
paper_authors._id: 657fd182c7cb69069abc3751
paper_authors.name: Jun Han
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2023-12-18T10:21:37.675Z
paper_authors._id: 6580149b9248a35061fb6f96
paper_authors.avatarUrl: /avatars/48d8dda9b32c3e07834b293f7d914654.svg
paper_authors.fullname: Jun Han
paper_authors.type: user
paper_authors.user: junhan91
paper_authors._id: 657fd182c7cb69069abc3752
paper_authors.name: Kai Chen
paper_authors._id: 657fd182c7cb69069abc3753
paper_authors.name: Haizhou Li
paper_authors._id: 657fd182c7cb69069abc3754
paper_authors.name: Zhizheng Wu
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2023-12-18T14:30:45.755Z
paper_authors._id: 63b4dcefa50cfcefdaa121f3
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/63b4dcefa50cfcefdaa121f3/MlIxOaTSCbZARVyo8Ly7r.jpeg
paper_authors.fullname: Dr Wuz
paper_authors.type: user
paper_authors.user: drwuz
paper_title: Amphion: An Open-Source Audio, Music and Speech Generation Toolkit
paper_summary: Amphion is a toolkit for Audio, Music, and Speech Generation. Its purpose is
  to support reproducible research and help junior researchers and engineers get
  started in the field of audio, music, and speech generation research and
  development. Amphion offers a unique feature: visualizations of classic models
  or architectures. We believe that these visualizations are beneficial for
  junior researchers and engineers who wish to gain a better understanding of the
  model. The North-Star objective of Amphion is to offer a platform for studying
  the conversion of any inputs into general audio. Amphion is designed to support
  individual generation tasks. In addition to the specific generation tasks,
  Amphion also includes several vocoders and evaluation metrics. A vocoder is an
  important module for producing high-quality audio signals, while evaluation
  metrics are critical for ensuring consistent metrics in generation tasks. In
  this paper, we provide a high-level overview of Amphion.
paper_ai_summary: Amphion is a toolkit for audio, music, and speech generation that includes model visualizations, vocoders, and evaluation metrics to support reproducible research and training for researchers.
paper_ai_keywords: vocoder evaluation metrics