on 1 february 1671/2, norreys married eleanor lee at adderbury. she was the elder daughter and coheir of sir henry lee, 3rd baronet and his wife ann danvers, both of whom had died in 1659. the danvers estates were left in trust for eleanor and her sister ann, who married thomas wharton in 1673; eleanor's aunt elizabeth, wife of robert villiers, later danvers, was also a beneficiary, but the trustees bought out her share in the year of ann's marriage. litigation arose between norreys, wharton, and their wives over the trust, and a partition of the estates in 1681 made abingdon, as he then was, and his wife the sole owners of the manors of west lavington, marden, and patney, wiltshire; they also received anne's share in the manor of westbury, wiltshire. the manor of bradenstoke was divided between anne and her aunt elizabeth until 1683, when abingdon bought out elizabeth's interest.