plummer married tammy grimes in 1956. their marriage lasted four years. they had a daughter together, actress amanda plummer. plummer was married to journalist patricia lewis from 1962, until their divorce in 1967. he later married actress elaine taylor in 1970. they lived together in weston, connecticut. he used to live in darien, connecticut before moving to weston. plummer had no children by his second or third marriages.