 Soon after the Grand Duchy of Lithuania was incorporated into the Russian Empire, officials ordered the demolition of the remaining sections of the palace.The structure was almost completely demolished in 1801, the bricks and stones were sold, and the site was bowered.Only a small portion of the walls up to the second floor in the eastern wing survived, that were sold to the Jewish merchant Abraham Schlossberg around 1800, who incorporated them into his house.