Between 1895 and 1947, the property was used by the United States Armed Forces as a training grounds, and was known as the Stony Point Rifle Range. The rifle range was used by Madison Barracks, Fort Ontario, and Pine Camp, now known as Fort Drum.