In 1956, Al-Gillani left Baghdad and migrated to Pakistan, where he settled permanently in Quetta. He stayed in Pakistan until he died in June 1991 in Germany, and later on he was buried in Lahore, Pakistan. He had three sons, AlSyed Mahmood Mohyuddin Al-Gillani Al-Qadri, AlSyed Abdul Qadir Jamaluddin Al-Gillani Al-Qadri and AlSyed Muhammad Ziauddin Al-Gillani Al-Qadri, who propagate the teachings of Silsilah e Qadiriyya Tahiria.