*ONE* Epyc server CPU has 64 cores and 128 threads. It supports 6 GPUs, such as the Titan RTX with 130 TFLOPS of performance and 24GB VRAM each. Adding the system RAM, 512GB of dual rank DIMMs, to the 144GB of VRAM mentioned earlier, gets you to a solid 656GB per CPU. If you have double socket boards, you can fit twice that in a 4u server chassis.

Total performance per server:

256 CPU cores

1560 TFLOPS of GPU performance

1.3TB RAM

And almost 4 kilowatts of power consumption, two and a half times what a 110v outlet is rated for. For the record, a typical household uses about 900 kilowatt-hours per month. This server would use that in less than ten days. This single metal box would consume three times as much power as an entire house of vacuum cleaners, hair dryers, and microwaves.