Szerb was born in 1901 to assimilated Jewish parents in Budapest, but baptized Catholic. He studied Hungarian, German and later English, obtaining a doctorate in 1924. From 1924 to 1929 he lived in France and Italy, also spending a year in London, England, from 1929 to 1930.