Born in Hong Kong on 23 October 1939 as the eldest son of Lee Hoi-chuen and Grace Ho. His younger brothers are martial artist and actor Bruce Lee and musician Robert Lee. Through Bruce, he was an uncle of American actors and martial artists Brandon Lee and Shannon Lee, and a brother-in-law of Linda Lee Cadwell.