Your first view of the castle will be the Gate House, which you pass through to reach the inner wards. 
You'll see the Gate House first.
It would be more convenient to do it now, with the army over there.