It is well known that he hated Yale, which he thought was full of intellectual snobs, and also that he did poorly there in academic terms.
Some clubs did not let him in, and that is the reason why he thinks Yale is full of snobs. 