In 1965 Dastgir married Kohinoor Rasheed Choudhury, the daughter of industrialist-cum-legislator and Member of British India's Central Legislative Assembly Abdur Rasheed Choudhury[5][17][18] and Member of the Pakistan National Assembly Serajunnessa Choudhury[5][17] of Sylhet, East Pakistan (currently Bangladesh). Mrs. Dastgir is a social worker and recipient of the International Red Cross Gold Medal. Their son Quazi Rumman Dastgir is a U.S. diplomat and their daughter Ayesha Dastgir is an international civil servant.