Wolseley lies at an altitude of 260 meters on the watershed between the drainage basins of the Breede River, which flows south to the Indian Ocean, and the Berg River, which flows north to the Atlantic Ocean.