Back outside, from the Episcopal Garden (Jardin de l'Evach??), at the rear of the cathedral, a stairway takes you down to the old town.
You can reach the old town via a staircase at the back of the cathedral.