Naming the property after the village of Vaucluse in the south of France, he built a small cottage and in 1803 set about transforming his "mere waste of land", building two huts and outbuildings, clearing 50 acres for agricultural uses and planting several thousand fruit trees.