Joseph Philippe Karam was born in Beirut in 1923, the fourth child of Philippe and Chafi'a Karam. His family were Christian Maronites from the historic village of Beiteddine in the Chouf mountains southeast of Beirut. He attended primary and secondary school in Beirut at the Jesuit Collège Notre Dame de Jamhour.