Also a keen golfer, Doyle was elected captain of the Crowborough Beacon Golf Club in Sussex for 1910. He had moved to Little Windlesham house in Crowborough with Jean Leckie, his second wife, and resided there with his family from 1907 until his death in July 1930.[54]