she and i were much closer by then and we both agreed that he was upset about leaving , that all love stories were not written by barbara cartland and the rough always had to be taken with the smooth .