I just bought the gpus.
I’ve been using the gpu about two weeks and it ran fine for a few train sessions.
I’m not sure it is relevant, but there were some weird incidents while using Apex.
When I terminated a python script with ctrl-c, sometimes Apex did not fully terminate and some sub-processes existed. Those sub-processes kept held GPU memories, so I had to kill them manually. These incidents made me suspect Apex.
I agree that it might be a hardware problem, but I wonder if a high GPU utilization might harm a gpu.
Is it possible that utilizing GPU 99% for a long time can affect the hardware (e.g. overheat)?
Moreover, is there any other way to utilize gpu up to 90% instead of using Apex?
When I tested some codes, gpu utilization was around 50~70% and I’m not sure whether it is normal.
I wanted to increase it, so I ended up with Apex.