After completing his studies at Mercersburg Academy in 1916, he graduated from Princeton University and in 1924 received a LL.B from the Harvard Law School, where he was a student of Felix Frankfurter. In 1925, Landis was a law clerk to Justice Louis Brandeis of the U.S. Supreme Court. He then became a professor at the Harvard Law School, until called into government service during the New Deal.