while in new york she also met robert and sally fitzgerald , who would invite her to live with them in their house in ridgefield , connecticut , to let her finish the novel without financial worries , or with fewer , as flannery put it .