 Van Ness was born in Kinderhook, New York on January 26, 1782 to a family of Dutch Americans.His father was Judge Peter Van Ness (1734–1804), who owned most of the land which President Martin Van Buren later purchased for construction of the Lindenwald estate.Cornelius Van Ness was the brother of William P. Van Ness and John Peter Van Ness.