Phillippe was born in New Castle, Delaware. He was married to actress Reese Witherspoon from 1999 until their divorce in 2007. The couple have two children. He also has a daughter from a relationship with actress Alexis Knapp.