It turned out that the Germans were misleading the inhabitants of the building, and they were all later arrested and transported in 1942 to the Majdanek concentration camp and killing center. There, Kantor was forced to do work for Ostindustrie, and was mentioned in the 1943 register of prisoners. He died there in 1943. The Jewish Polish swimmer Ilja Szrajbman, who had also participated in the 1936 Berlin Olympics, was also killed by the Nazis that year. Kantor was one of approximately 3 million Polish Jews murdered during the Holocaust.