there was no doubt in his mind that her opinion of him had been altered after seeing him with lady vernon , and while he knew that he was to blame for that , he could n't help but feel frustrated by her blunt dismissal of him .