There is a difference between pointing it out and guessing. If the character doesn't clear the perception test and actually sees it, they can't point it out. Even if Iefyr was right in his suspicion it doesn't mean he could have known from where they attacked and exactly when. Even if one is ready for something it can still surprise when it happens. Hence we were all surprised