From the reservoir , the first stage of the tunnel reached south into the center of the Bronx , then west across the Harlem River into Upper Manhattan and then down the west side of Manhattan and east into Central Park , crossing under the East River and into Astoria , Queens .