The entire estuary extends inland from the mouth of the Piscataqua River between Kittery, Maine, and New Castle, New Hampshire through Little Bay into Great Bay proper at Furber Strait, a distance of 12 miles .