The Tayloes were a greatly distinguished Virginia family: His grandfather, Colonel John Tayloe (d. 1747), was a member of the King's Council in Virginia and owner of more than 3000 acres of land (a huge estate at the time), and his father, Colonel John Tayloe II, built the historic Mount Airy manor house in 1758 and was also a member of the King's Council. [