He makes it back to the castle fairly easily, and can be pretty sure he wasn't observed. He'll have to wait a few minutes, for a chance to approach the walls without being seen, but it shouldn't be that difficult.