Er war ab 1768 mit Elisabeth Berenberg, die Tochter von Johann Berenberg (1718–1772) und die einzige Erbin der Bankiersfamilie Berenberg, verheiratet. ###>Upon the death of Johann Berenberg's brother Cornelius in 1773, the Berenberg family became extinct in the male line and Johann Hinrich Gossler became the company's sole owner.