Although during the campaign Mr. Rinfret promised that he would be '' moving the devil out of New York State '' if he lost , he initially reversed himself and elected to stay in his home on the Upper East Side , declaring , '' I love New York too much . ''