He was the only child of Cleland and Florence Righter Benedict and a descendant of an illustrious old New York and New England family , which included his ancestor , the second president of Harvard University , Charles Chauncey , and the first mayor of Bridgeport , Connecticut , Lemuel Coleman .