Toward the end of his life, his two remaining properties on the Hill were on its North Slope, traditionally the side where servants of patrician South Slope residents lived. He accommodated a motley collection of tenants, mostly young gay men, in an eight-unit building at 75 Phillips St; Prescott himself inhabited an old brick townhouse at the end of Lindall Pl, a cul-de-sac that terminated just behind the Philips Street apartments. A subterranean corridor lined with cubicles connected the basements of the two buildings. The tunnel was said to have housed runaway slaves in transit on the Underground Railway prior to the Civil War. Townsend had, for years, been suffering from failing health brought on by Parkinson's disease, and on May 23, 1973 his body was found in the Beacon Hill apartment of John Murray who had been caring for him during the final years of his life. The police reported that "when we came in to take charge of the body, Mr. Townsend was found in a kneeling prayer position at his bedside." Of his entire family, only one sister, a nephew and a great-nephew attended his memorial service at the Arlington Street Church.