Both were left derelict by Norman invaders , and Bishop Maurice de Sully authorized construction of the cathedral to replace them in 1163 .
The Bishop allowed the construction for the cathedral in 1163 .