Weiss took command of the XXVII Army Corps on 1 July 1942. Weiss led the 2nd Army on the Eastern Front from 3 February 1943 on. He received command of Army Group North on 12 March 1945 with which he surrendered to the American forces.