Scottish kings came to favor the site, and it was James IV who decided to transform the simple lodgings into a true royal palace.
Scottish Kings always disliked the place and James IV wildly made it into a royal palace.