Between 1940 and 1941, Rauff went back to the Navy as a volunteer, commanding a mine sweeper flotilla in the English Channel. He was promoted to Lieutenant Commander (Korvettenkapitän) in April 1941, shortly before he was discharged from active service, he then returned to the Reich Security Main Office.