Have you already tried to wipe your cuda + nvidia driver install and redo it from scratch? Maybe try that on a bootable drive not to mess with your current install.
If that does not help, maybe remove and put back the GPUs in the machine? They might not be properly installed physically.