Lindsay , who , like Mr. Miller represented Manhattan 's Upper East Side -LRB- it was called the Silk Stocking District then -RRB- , described white Anglo-Saxon Protestants as an endangered species and added : '' You realize you ca n't call any other ethnic group by its pejorative name .