Toppmöller became coach of FSV Salmrohr from summer 1987 to 18 April 1988 when he became coach of SSV Ulm 1846 until February 1989. After his dismissal, Toppmöller coached East German second division side FC Erzgebirge Aue from 28 November 1990 to 30 June 1991. He then transferred back to the Federal league with SV Waldhof Mannheim from 19 September 1991 to 30 June 1993.