Always active in Zionist circles, Rosen was Chairman of Zionist Federation in Germany from 1920–1923, and eventually migrated to Palestine in 1926 where he practiced as a lawyer and helped create the Central European Immigrants Association.