As the pay and purchasing power of Manhattan residents have moved higher and higher , incomes in all four of the boroughs outside Manhattan have trailed inflation over the last few years , in a stark example of the increasing income disparity in New York City .