Answers.Body: <p>It depends on the exact studio's process, but generally either an animatic (basically a roughly animated storyboard) or the audio is done first.  In the case of Family Guy and American Dad specifically, it sounds like they work on the audio and the animatic first.  The advantage to doing an animatic first is it can help the voice actors visualize what will be happening, but that makes the process take a bit longer (which is particularly bad for TV).</p>
  
  <p>Once the final audio is done, the final animation can be done to match the sound.  It's actually fairly easy just looking at the wave file of an audio track to pick out where the syllables are, though there is also software that can be used to automatically identify the proper moments for different types of mouth movements with pretty decent accuracy.  Once you know all the key frames (the particular points in time that need to have a given mouth shape) it's pretty easy to animate in between them to get the proper facial movement.</p>
  
  <p>While I was researching American Dad's particular process for this question, I also stumbled across this video from the Wall Street Journal that I thought might be of interest relating to the question.</p>
  
  <p><div class="youtube-embed"><div>
                  <iframe width="640px" height="395px" src="https://www.youtube.com/embed/w6rrdNFaY_g?start=0"></iframe>
              </div></div></p>
  
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2014-04-01T05:30:54.743Z
Answers.Text: That is way beyond any of my expectations. Thank you for your time and research!
Answers.UserDisplayName: user40
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2014-04-01T03:08:20.223Z
Answers.LastActivityDate: 2014-04-01T03:08:20.223Z
Answers.UserDisplayName: AJ Henderson
Body: <p>In some modern cartoons the animation of face, particularly mouth, is very realistic - most of vowels are mimicked correctly and on-time by mouth movements. (Particularly I'm talking about Family Guy episodes).</p>
  
  <p>My main question - what is created first - animation or sound recording? </p>
  
  <p>How the process of combining those two looks like? I think it is a complicated task to match sound and animation. </p>
  
  <p>Is there a software that recognizes words that actor have said and automatically simulates mouth movements? </p>
  
Tags: <video><audio><animation>
Title: In cartoons, what is created first - video or sounds?
UserDisplayName: user40
ThreadText: # In cartoons, what is created first - video or sounds?
  
  (Asked by: username_0 on 2014-04-01)
  
  In some modern cartoons the animation of face, particularly mouth, is very realistic - most of vowels are mimicked correctly and on-time by mouth movements. (Particularly I'm talking about Family Guy episodes).
  
  My main question - what is created first - animation or sound recording?
  
  How the process of combining those two looks like? I think it is a complicated task to match sound and animation.
  
  Is there a software that recognizes words that actor have said and automatically simulates mouth movements?
  
  **Tags:** video, audio, animation
  
  
  ---
  
  ## 1 answers
  
  ### Answer by username_1 on 2014-04-01. Score: 6 | Accepted answer
  
  It depends on the exact studio's process, but generally either an animatic (basically a roughly animated storyboard) or the audio is done first. In the case of Family Guy and American Dad specifically, it sounds like they work on the audio and the animatic first. The advantage to doing an animatic first is it can help the voice actors visualize what will be happening, but that makes the process take a bit longer (which is particularly bad for TV).
  
  Once the final audio is done, the final animation can be done to match the sound. It's actually fairly easy just looking at the wave file of an audio track to pick out where the syllables are, though there is also software that can be used to automatically identify the proper moments for different types of mouth movements with pretty decent accuracy. Once you know all the key frames (the particular points in time that need to have a given mouth shape) it's pretty easy to animate in between them to get the proper facial movement.
  
  While I was researching American Dad's particular process for this question, I also stumbled across this video from the Wall Street Journal that I thought might be of interest relating to the question.
  
  > **Comments:**
  > **username_0**: That is way beyond any of my expectations. Thank you for your time and research!  
  
  ---
  
  