You can leave if you want, but you won't be able to enter without winning the fight. If you want to reset your 'morals' and past deeds, you can go on a little trip up the mountain to a place where you can cleanse yourself. After that, you'll be able to just walk in. If not, you'll have to fight!