archbishop imre esterházy (who was archbishop from 1725 to 1751) had the garden reconfigured in a baroque style. it was under archbishop ferenc barkóczy (who was archbishop from 1761 to 1776) that the current version of the palace was built. between 1761 and 1765, barkóczy had austrian architect f. a. hillebrandt convert the old lippay building into a large baroque palace. also, rococo style decorations, a rococo fence and a yard of honour were added.