Mr. Carter , is survived by his wife of 44 years , Louise Cahill Carter of Washington and Palm Beach , Florida , his three children Warwick M. Carter Jr. , of Darien , Connecticut , Prescott C. Carter , of Brooklyn , New York , and Lee C. Carter , of Washington , D.C. as well as four grandchildren , and his five brothers .