Representative Charles B. Rangel of New York , the ranking Democrat on the House Ways and Means Committee , said it was unfair to burden merely affluent taxpayers with higher taxes , especially since most of the benefits of the reduced capital gains rates go to those with incomes of more than $ 1 million annually .