On 22 October 1682, the palace burnt down to a shell. Due to the political situation in Spain and the crisis around the succession, King Charles II was not abled to restore the palace. His successor King Philip V built close by a new palace: "La Granja" (Royal Palace of La Granja de San Ildefonso).