In the manga, I don't know if it's different in the Anime, the Vongola Castle was in a gigantic forest miles away from any town. But, then again, it was destroyed by the fake Six Funeral Wreaths member in charge of the main battle in Italy, so they might have rebuilt elsewhere.