he was married to margaret griswell neal from 1937 until they divorced in 1959 or 1960. they had three children. then he was married to virginia warren from 1960 until his death in 1991. virginia was the daughter of chief justice earl warren.