Born Josef Karlenboim in Hrubieszów in the Russian Empire (today in Poland), he joined the Dror movement in 1924 and moved to Mandate Palestine in 1930. He served as a commander of the Haganah in Kfar Saba, Tel Aviv (1936) and Haifa (1937). In 1940, he enlisted in the British Army, and fought in Greece.