On her return from Haiti, Brown moved to Alabama in 1937 and worked at the Tuskegee Institute as a history teacher until 1940.[1][2][3] In 1940, she joined LeMoyne-Owen College as a history teacher after a move from Alabama to Memphis, Tennessee.[1][3] She continued teaching at LeMoyne-Owen College until 1945.[1][2] Brown faced the same problem as most black educators during that era, in that they were offered appointments to teaching positions in higher education only in historically African American universities and colleges.