Though Brooklyn as a whole has been losing white residents for decades , the number living near the project site -- in neighborhoods like Fort Greene , Boerum Hill and Prospect Heights -- has grown steadily in recent years , according to census data .