The house was built by Francis Caleb Green, on part of the 2400 acres of land granted in 1666 to the sons of Thomas Greene, the second Provincial Governor of Maryland, who named it "Green's Inheritance."