Stoller was born in 1898 in Moscow, Russian Empire. In 1915, he graduated from high school and began to study history and linguistics at Moscow State University. In February 1917, he was drafted into the ranks of the army of the Russian Empire, but he defected after the October Revolution and moved with his family to the Crimea.