FastVoiceGrad: One-step Diffusion-Based Voice Conversion with
  Adversarial Conditional Diffusion Distillation
Diffusion-based voice conversion (VC) techniques such as VoiceGrad have
attracted interest because of their high VC performance in terms of speech
quality and speaker similarity. However, a notable limitation is the slow
inference caused by the multi-step reverse diffusion. Therefore, we propose
FastVoiceGrad, a novel one-step diffusion-based VC that reduces the number of
iterations from dozens to one while inheriting the high VC performance of the
multi-step diffusion-based VC. We obtain the model using adversarial
conditional diffusion distillation (ACDD), leveraging the ability of generative
adversarial networks and diffusion models while reconsidering the initial
states in sampling. Evaluations of one-shot any-to-any VC demonstrate that
FastVoiceGrad achieves VC performance superior to or comparable to that of
previous multi-step diffusion-based VC while enhancing the inference speed.
Audio samples are available at
https://www.kecl.ntt.co.jp/people/kaneko.takuhiro/projects/fastvoicegrad/.
66d95844776a130de772b135
Takuhiro Kaneko
66d95844776a130de772b136
Hirokazu Kameoka
66d95844776a130de772b137
Kou Tanaka
admin_assigned
2024-09-05T09:39:38.050Z
665b675b4dcff58f9a848b1b
/avatars/e86c6db5f2b75aaaffac749dbaf08046.svg
Kou Tanaka
user
ououo
66d95844776a130de772b138
Yuto Kondo
FastVoiceGrad: One-step Diffusion-Based Voice Conversion with
  Adversarial Conditional Diffusion Distillation
Diffusion-based voice conversion (VC) techniques such as VoiceGrad have
attracted interest because of their high VC performance in terms of speech
quality and speaker similarity. However, a notable limitation is the slow
inference caused by the multi-step reverse diffusion. Therefore, we propose
FastVoiceGrad, a novel one-step diffusion-based VC that reduces the number of
iterations from dozens to one while inheriting the high VC performance of the
multi-step diffusion-based VC. We obtain the model using adversarial
conditional diffusion distillation (ACDD), leveraging the ability of generative
adversarial networks and diffusion models while reconsidering the initial
states in sampling. Evaluations of one-shot any-to-any VC demonstrate that
FastVoiceGrad achieves VC performance superior to or comparable to that of
previous multi-step diffusion-based VC while enhancing the inference speed.
Audio samples are available at
https://www.kecl.ntt.co.jp/people/kaneko.takuhiro/projects/fastvoicegrad/.
FastVoiceGrad is a one-step diffusion-based voice conversion technique that matches or exceeds the performance of multi-step diffusion models while significantly improving inference speed.
diffusion-based voice conversion VoiceGrad multi-step reverse diffusion one-step diffusion adversarial conditional diffusion distillation ACDD generative adversarial networks