He'll find his tail after a few minutes; they're pretty good about it. The man came in in civilian clothes, with several others who were clearly not in on the observation, and didn't do much to draw attention to himself. Likely the only reason Caiaphas would notice is because he was one of the other patrolmen he spotted, while entering the city. No one actively approaches him, or makes any overt moves against him, though.