Tesla Autopilot HW3 details
> As a point of reference - Google’s TPU V1, which is the one that Google uses to actually run neural networks (the other versions are optimized for training) is very similar to the specs I’ve outlined above.The TPU V1 is a 2015 chip (publicly announced in 2016, and that Google had been using internally for over a year). 4 years is a big lag in terms of technology.Additionally, the comment about "actually run neural networks " seems to be, AFAIK, plainly wrong. The first version was limited to inference because it could only perform integer operations, while V2 and onward support both training and inference, as they can perform float operations.TPU V1 was never available to the public, but both V2 and V3 are available on Google Cloud. I don't have any info on it, but at this point, I'd expect all V1 chips to have been deprecated and likely removed from production, given the savings in space and power from V2 and V3.