Rubinstein was born to Jewish parents in the village of Vikhvatinets in the Podolian Governorate, Russian Empire (now known as Ofatinți in Transnistria, Republic of Moldova), on the Dniestr River, about 150 kilometers northwest of Odessa.