The Gardens are located 5 kilometers northeast of the town of Romsey in Hampshire, England, and were formerly known simply as the Hillier Arboretum, founded by nurseryman Harold Hillier in June 1953 when he acquired Jermyn's House and its grounds.