he really ought to have left this watchful waiting to his subordinates , but he could n't bear to cool his heels in his townhouse , all the while tormenting himself with the thought of her forced to bear the company of a man who 'd brought her such grief .