Cloud TPUs in Beta
That $6.50/hr rate might be the big deal here. Amazon does offer instances with a V100 GPU (<a href="https://aws.amazon.com/ec2/pricing/on-demand/" rel="nofollow">https://aws.amazon.com/ec2/pricing/on-demand/</a>, the P3 instances), but if you're training something like ImageNet, you'll want the biggest image (p3.16xlarge) at <i>$24.48/hr</i>.<p>Attaching a VM of similar power to a TPU on Google Compute Engine is much cheaper (<a href="https://cloud.google.com/compute/pricing" rel="nofollow">https://cloud.google.com/compute/pricing</a>, n1-highmem-64, +$3.78/hr to the TPU cost for $10.28/hr total).<p>Per recent benchmarks for training ImageNet (<a href="https://dawn.cs.stanford.edu/benchmark/" rel="nofollow">https://dawn.cs.stanford.edu/benchmark/</a>), training ImageNet on a p3.16xlarge cost $358, when this post claims it'll cost less than $200. (EDIT: never mind; the benchmark uses ImageNet-152, and Google compares TPU performance against ImageNet-50) Interesting.