Born in Vienna, he was the son of musician and pedagogue, Georg Hellmesberger Sr. (1800–1873), and was taught violin by his father at the Vienna Conservatory. Hellmesberger hails from a family of notable musicians including: brother, Georg Jr. (1830–1852); son, Josef Jr.