But why do we (they) keep on calling them GPUs?<p>And why not improve their form factor? Currently, a GPU hardly fits into a server slot. And a typical desktop can host at most 2-3 of them.<p>As a radical idea: why not design this type of auxiliary computing power as separate boxes that can be attached to a desktop or server computer by a cable?