In addition to his home in Washington City, Tayloe owned Petworth, a 205 acres estate in Washington County near the Soldiers' Home at the northeast corner of 7th Street Pike and Rock Creek Church Road.