when the time came , and it would he knew , to let her slip into the past along with the others who had come and gone since his freedom , he would have to confront her presence more frequently than he wished .