In 1573 Gorges acquired the manor of Langford (now Longford Castle) in Wiltshire. With the artistic direction of his wife he built the surviving Longford Castle on the banks of the River Avon, to the south of the city of Salisbury, a triangular Swedish pattern castle with a round tower in each corner, with deer park, fruit garden and kitchen garden.