We call them GPUs because they are built from GPU chips. The Tesla M40 for example is based on a GM200 chip which is the same as in a GeForce GTX Titan X GPU.<p>Also Nvidia and other assemblers have done exactly that: separate boxes that you attach to servers by a PCIe cable. See for example the Tesla S2050 server: <a href="http:&#x2F;&#x2F;www.nvidia.com&#x2F;docs&#x2F;io&#x2F;43395&#x2F;nv-ds-tesla-s2050-june10-final-lores.pdf" rel="nofollow">http:&#x2F;&#x2F;www.nvidia.com&#x2F;docs&#x2F;io&#x2F;43395&#x2F;nv-ds-tesla-s2050-june10...</a><p>A good list of Tesla systems is at <a href="https:&#x2F;&#x2F;en.wikipedia.org&#x2F;wiki&#x2F;List_of_Nvidia_graphics_processing_units#Tesla" rel="nofollow">https:&#x2F;&#x2F;en.wikipedia.org&#x2F;wiki&#x2F;List_of_Nvidia_graphics_proces...</a> (which, coincidentally, I have been heavily updating these last few days).