As @omarfoq explained, you usually want to fully utilize the GPU to get the best performance.
If your system hits a thermal issue, you might either want to fix it (better cooling) or artificially slow down your code by e.g. limiting the power usage (which would also slow down your code and is not the optimal solution).