During World War II, Herff served with the Deutsches Afrika Korps in North Africa. He was promoted to Oberst (colonel) and commanded "Kampfgruppe von Herff". For his service in North Africa he was awarded the Knight's Cross of the Iron Cross in June 1941[2].