Answers.Body: <p>From what I've seen, these two models have similar architectures since they took the architecture of SoftVC and combine it with the design of VITS. The RVC is a succession of SoVITS and it has some improvements.</p>
  <p>Firstly, the RVC used ContentVec as the content encoder rather than HuBERT. ContentVec is an improved version of HuBERT, and it can ignore speaker information and only focus on content.</p>
  <p>Secondly, the RVC used top1 retrieval to reduce tone leakage. It is just like the codebook used in VQ-VAE, mapping the unseen input into known input in the training dataset.</p>
  <p>But according to the 4.1 version update in the SoVITS repo, they replaced HuBERT with ContentVec and also added feature retrieval functionality, so their performance should be the same now.</p>
  <p><strong>7/7 Update:</strong></p>
  <p>I just talked to their developers and confirmed that their architectures are nearly the same, except that in SoVITS you can select which content encoder to use (HuBERT or ContentVec).
  I drew a graph to illustrate the model of RVC:
  <a href="https://i.sstatic.net/M0OcW.jpg" rel="nofollow noreferrer"><img src="https://i.sstatic.net/M0OcW.jpg" alt="RVC Arch" /></a></p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2024-03-18T10:32:46.603Z
Answers.Text: when you say ContentVec, do you mean vec-768-layer-12? So is that better than hubert_base.pt? thanks!
Answers.UserDisplayName: user17952421
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2024-03-20T11:18:56.187Z
Answers.Text: @user17952421 I didn't find vec-768-layer-12 but I guess it's a checkpoint from ContentVec, which I would say is not "better" but rather "different". ContentVec is an effort to remove speaker information from voice. It adopts a similar model as Hubert but uses Hubert as a Teacher model and uses some voice conversion on input so that the model learned how to ignore the tone from different speakers.
Answers.UserDisplayName: Cat ALog
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2023-06-30T14:04:18.700Z
Answers.LastActivityDate: 2023-07-07T15:49:51.920Z
Answers.LastEditDate: 2023-07-07T15:49:51.920Z
Answers.UserDisplayName: Cat ALog
Body: <p>I'm trying to decide which one to use for my project but I can't find anywhere specific differences or comparisons of the models.</p>
  
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2023-06-22T21:56:54.967Z
Comments.Text: You should provide more details about your project and what you want to achieve, and why you even considered these models.
Comments.UserDisplayName: nbro
Tags: <audio-processing>
Title: What are the differences between RVC and SO-VITS-SVC models?
UserDisplayName: Hiperfly
ThreadText: # What are the differences between RVC and SO-VITS-SVC models?
  
  (Asked by: username_0 on 2023-06-22)
  
  I'm trying to decide which one to use for my project but I can't find anywhere specific differences or comparisons of the models.
  
  **Tags:** audio-processing
  > **Comments:**
  > **username_1**: You should provide more details about your project and what you want to achieve, and why you even considered these models.  
  
  ---
  
  ## 1 answers
  
  ### Answer by username_2 on 2023-06-30. Score: 2 | Accepted answer
  
  From what I've seen, these two models have similar architectures since they took the architecture of SoftVC and combine it with the design of VITS. The RVC is a succession of SoVITS and it has some improvements.
  
  Firstly, the RVC used ContentVec as the content encoder rather than HuBERT. ContentVec is an improved version of HuBERT, and it can ignore speaker information and only focus on content.
  
  Secondly, the RVC used top1 retrieval to reduce tone leakage. It is just like the codebook used in VQ-VAE, mapping the unseen input into known input in the training dataset.
  
  But according to the 4.1 version update in the SoVITS repo, they replaced HuBERT with ContentVec and also added feature retrieval functionality, so their performance should be the same now.
  
  **7/7 Update:**
  
  I just talked to their developers and confirmed that their architectures are nearly the same, except that in SoVITS you can select which content encoder to use (HuBERT or ContentVec).
  I drew a graph to illustrate the model of RVC:
  [![RVC Arch](https://i.sstatic.net/M0OcW.jpg)](https://i.sstatic.net/M0OcW.jpg)
  
  > **Comments:**
  > **username_3**: when you say ContentVec, do you mean vec-768-layer-12? So is that better than hubert_base.pt? thanks!  
  > **username_2**: @user17952421 I didn't find vec-768-layer-12 but I guess it's a checkpoint from ContentVec, which I would say is not "better" but rather "different". ContentVec is an effort to remove speaker information from voice. It adopts a similar model as Hubert but uses Hubert as a Teacher model and uses some voice conversion on input so that the model learned how to ignore the tone from different speakers.  
  
  ---
  
  