The '' gardening leaves '' term , originally from England , describes an old notion that departing investment bankers in the City , London 's financial district , would spend three to six months puttering around their gardens before starting with a competing firm .