Manheim was born in New York City. He lived for a year in Germany and Austria as an adolescent, graduated from Harvard at the age of 19,[3] and spent time in Munich and Vienna (studying at the universities)[2] before the rise to power of Adolf Hitler. He also undertook post-graduate study at Yale and Columbia universities.