I am not a big fan of Comey, but it is likely that he took the question as "as an FBI director did you...". He wasn't an FBI director back when George W Bush was in the office. 

The attorney knows about this George W Bush memo, because it is public knowledge. And James Comey made sure it was public knowledge. Hence it doesn't make sense for him to purposely give wrong information under oath.