She was able to take the Scindia queens to safety to Narwar. It is known that the rebels respected her: Tantia Tope kept up a correspondence with her, urging her to take over the rule of Gwalior. To show good faith, Baiza Bai handed over the letters to the British. Clearly, she was able to walk a fine line to maintain a cordial relationship with her family, the rebels as well as the British. Baiza Bai died in Gwalior in 1863. There are several tangible remnants of Baiza Bai's philanthropy and support of the arts and religion. As a queen and dowager, she endowed temples and worship grounds across the Scindia domains as well as sacred sites in North India. In Benares, Baiza Bai is said to have built the colonnade around the Gyanvapi well in 1828. In 1830, she also built a temple close to the south turret of the Sindhia Ghat, one of the grandest ghats on the riverfront. Prior to Daulat Rao's transfer of the Scindia capital to Gwalior, the first city of the kingdom was Ujjain. During her charge of the city, in 1848, Baiza Bai built the Gopal Krishna temple there. It comprised two large towers situated on either side of a square structure topped by a dome. A statue of Baiza Bai appears to the side of a black idol of Krishna. She also built a temple on the Pishachavimochan ghat on the Shipra River, which was her own chhatri. In 1850, a reservoir called the "Baizataal" was constructed within the grounds of the Moti Mahal palace at Gwalior under her name.