Huang did not have a happy family life. He had two sons. The older one, Huang Han-lin, studied with his father but was later killed by a barrage of bullets in an attack against bandits. Huang Fei-hong was devastated and decided not to pass his kungfu on to his second son, Huang Han-hsi.
黃飛鴻的家運並不順利，他有兩個兒子，老大黃漢霖跟著父親習武，但後來在剿土匪時被亂槍打死，黃飛鴻傷心之餘便不再傳老二黃漢熙武藝。