Born in Tripoli in Libya in 1939, Rubin made aliyah to Israel in 1949. He studied humanities at the Hebrew University of Jerusalem, and earned a teaching certificate from the university's Education Department, going on to work as a teacher. He later also studied journalism at Tel Aviv University.