Answers.Body: <p>You can check <a href="https://github.com/Harmonai-org/sample-generator" rel="nofollow noreferrer">sample-generator</a>, an implementation of stable diffusion for audio data from <a href="https://www.harmonai.org/" rel="nofollow noreferrer">Harmonai</a>. I'm playing with it recently and I can say it works pretty well already out the shelf. With some hacks I was also able to reduce the model size and run a training on cpu.</p>
  <p>And if you have the proper gears they also provide pretrained weights of some of their models.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2022-11-03T12:48:15.630Z
Answers.LastActivityDate: 2022-11-03T12:48:15.630Z
Answers.UserDisplayName: Edoardo Guerriero
Body: <p>Generative AI is being used to create amazing art; first through paid services like Midjourney and now also with free, open source alternatives like Stable Diffusion. Now you can even generate art in a particular style, first with Google's Dreambooth and later with open-source implementations of the same.</p>
  <p>Is there a Generative AI program for audio that allows you to create a model/style of a particular voice exemplar?</p>
  <p>I am looking to train a voice model in a particular style using the aural equivalent of Dreambooth, and then apply that voice model/style to written text. Ideally I could review several options, and then pick certain ones to expand upon and later upscale.</p>
  <p>I have researched this extensively but all of the voice generation services I have found are 1) paid 2) closed source 3) don't allow you to train the software on specific audio samples or 4) don't sound very natural at all.</p>
  <p>Are there modern generative AI services for text-to-audio?</p>
  
Tags: <reference-request>
Title: Are there free and open-source audio versions of Generative AI programs like Stable Diffusion?
UserDisplayName: kanamekun
ThreadText: # Are there free and open-source audio versions of Generative AI programs like Stable Diffusion?
  
  (Asked by: username_0 on 2022-11-03)
  
  Generative AI is being used to create amazing art; first through paid services like Midjourney and now also with free, open source alternatives like Stable Diffusion. Now you can even generate art in a particular style, first with Google's Dreambooth and later with open-source implementations of the same.
  
  Is there a Generative AI program for audio that allows you to create a model/style of a particular voice exemplar?
  
  I am looking to train a voice model in a particular style using the aural equivalent of Dreambooth, and then apply that voice model/style to written text. Ideally I could review several options, and then pick certain ones to expand upon and later upscale.
  
  I have researched this extensively but all of the voice generation services I have found are 1) paid 2) closed source 3) don't allow you to train the software on specific audio samples or 4) don't sound very natural at all.
  
  Are there modern generative AI services for text-to-audio?
  
  **Tags:** reference-request
  
  ---
  
  ## 1 answers
  
  ### Answer by username_1 on 2022-11-03. Score: 3
  
  You can check [sample-generator](https://github.com/Harmonai-org/sample-generator), an implementation of stable diffusion for audio data from [Harmonai](https://www.harmonai.org/). I'm playing with it recently and I can say it works pretty well already out the shelf. With some hacks I was also able to reduce the model size and run a training on cpu.
  
  And if you have the proper gears they also provide pretrained weights of some of their models.
  
  
  ---
  
  