They'd make their way out to gather their mounts easily enough, though he'd likely notice some of the guards acting suspiciously. A DC 20 Sense Motive let's him notice that they seem to be watching the group closely, and passing along messages. Someone was likely to find out about their departure, and soon.