The castle was at the northwest edge of town. Logically, if Neil went northeast, he should reach the edge of town in roughly the same amount of time. And from there? He could figure out what to do once he was safe and secure.