The gardens are located on the upper tier of St. Peter & Paul Bastion, which was built in the 1560s. The bastion's lower tier contains the Saluting Battery. The garden's terraced arches were built in 1661 by the Italian knight Fra Flaminio Balbiani.