The Tookers New York residence was at 675 Fifth Avenue. Together, they were the parents of:   His wife died in Rome, Italy on February 4, 1888. Tooker died on December 11, 1905 at Monte Carlo in Monaco, after having lived abroad for twenty years. He was buried alongside his wife in Rome, however, a memorial was place at Island Cemetery in Newport, Rhode Island. Through his daughter Charlotte, he was the grandfather of Charlotte Augusta Warren (1885–1957), who married William Greenough, and Whitney Warren Jr. (1898–1986), who was a horticulturalist and patron of the arts. Warren Jr. was referred to as "an overly rich bachelor operating in San Francisco" who traveled around the world.