Mr. Swett bought and refurbished residential and commercial buildings on the East and West Sides of Manhattan , as well as in some of the city 's less gentrified areas , including Harlem , the South Bronx and Greenpoint , Brooklyn .