Rachmilewitz was born in 1898 in Mstislavl (now in Belarus), then part of the Russian Empire, and grew up in the city of Babruysk. His parents were Eliezer Lipman Rachmilewitz and Dvosha Zack. After completing high school, he studied medicine in Germany.