This is the former boundary of the town of Edinburgh and the neighboring town , called Canongate , which was a community of aristocrats and members of the royal court serving Holyrood Palace .
Nobody except the wealthy lived within Canongate 's boundaries .