Brooklyn-born and raised in Ithaca , N.Y. , Paul Dundes Wolfowitz , 61 , is the son of a Cornell University mathematician who left Poland after World War I . The rest of his father 's family perished in the Holocaust .