Running in visual code terminal, or separate terminal. (same problem)
Concerning power supply, we had also drops in CPU frequency, they are now gone.
Running the same code on a single GPU is fine (just slower)