` But neither the prince nor his friend had any intention of allowing us to enter the Sultan 's palace , though it was difficult to know how we were to escape , and what was to become of us when once we had escaped .