Multiple processes using the same devices shouldn’t cause this issue and since I cannot reproduce the issue on our A100 servers, I would guess it might be a setup issue. Hardware defects could of course also cause such weird issues, but since you are able to reproduce it on multiple devices in the server, I doubt it’s the case.
Did the admin provide any information about the setup of the machine? I’m also not familiar with your lease of the node, but could you try another one?