 Berger was born to a rabbi in Jerusalem.He immigrated to the United States when he was in his teens, and became a naturalized American citizen in December 1955.Berger was the first featherweight in history to lift more than , and the first to press double his body weight.