I did, I did not find any such setting. In the NVIDIA X Server application, the PRIME profile is set to ‘Intel (power save)’ but that is because I’m using the Intel card for display.
I will experiment some more and see in what cases does this happen. Will update this thread at a later time.