In the 1960s, Lee taught for a while at La Salle College and joined the Royal Observatory Hong Kong as its Assistant Director where he contributed significantly to the technical development of the Observatory's detection of tropical cyclones. He was also the coach of La Salle Fencing Team since 1968, with eleven wins at the Inter-School Fencing Championship in thirteen years.