Why Nvidia Keeps Winning
CUDA was a great technology before 2018.<p>Then in 2018, they prohibited usage of GeForce GPUs in data centers: <a href="https:&#x2F;&#x2F;www.datacenterdynamics.com&#x2F;en&#x2F;news&#x2F;nvidia-updates-geforce-eula-to-prohibit-data-center-use&#x2F;" rel="nofollow noreferrer">https:&#x2F;&#x2F;www.datacenterdynamics.com&#x2F;en&#x2F;news&#x2F;nvidia-updates-ge...</a> And during 5 years which followed, they have reached the point where for many use cases nVidia is dramatically worse value compared to competitors.<p>On my day job I do CAM&#x2F;CAE, we compute a lot of FP64 numbers. Because we use D3D tech for GPGPU, we recently bought some computers with AMD 7900 XTX. These GPUs were sold for about $1000. An nVidia equivalent is L40: the AMD is 1.459 TFlops and 0.96 TB&#x2F;sec memory bandwidth, the nVidia is 1.414 TFlops and 0.864 TB&#x2F;sec memory bandwidth, but the nVidia is sold for about $9000. That’s an order of magnitude difference in cost efficiency.