I built a PC with the following parts:
Asrock B450M motherboard.
AMD Ryzen 3 3100 processor (no internal GPU).
Asus GT 710 graphics card (basic Nvidia one).
A single HYNIX RAM 8gb stick
EVGA 400W (but it doesn't matter really).

I'm trying to install OS on it.
Any OS will do (Windows 10, Ubuntu, whatever).

The problem I'm having is that

* when I boot with Windows 10 USB (I've tried 3 already) see the "choose installation method" menu for a second and then I get Blue Screen Of Death (in both Normal mode and Safe mode).
* when I boot Ubuntu Live USB it gets to the GNOME desktop, then goes black, then goes back to GNOME but now it's frozen.

I googled it and they say it's due to installers using some basic NVidia drivers that don't work for this card.

I ran memtest86 - the RAM is 100% functional.
CPU is brand new.
The motherboard is brand new.

Asus Nvidia card is used, but I've seen photos of it working.

I assume I don't have the right Nvidia drivers.
I'm trying now to install Ubuntu Server Edition, will say how it goes, but please let me know if I can fix it.

Hopefully, I don't have to buy a new CPU with a built-in GPU or something.