 It borders the New York counties of Dutchess, Putnam, Rockland, Sullivan, Ulster, and Westchester, as well as Passaic and Sussex counties in New Jersey and Pike County in Pennsylvania.Orange County is the only county in New York State which borders both the Hudson and Delaware Rivers.Orange County is where the Great Valley of the Appalachians finally opens up and ends.