she was born at beaulieu abbey, hampshire, on 26 september 1909, the second daughter of the 2nd lord montagu by his first wife lady cecil kerr. she was a direct descendant of charles ii and lucy walter, via their son, the duke of monmouth. her mother died in the 1918 flu pandemic. varley attended st margaret's school, bushey, and attended a finishing school at lausanne, but was not interested in society life and chose instead to train as an actress at the rada from 1932.