The Pixel 8 Pro's Tensor G3 off-loads all generative AI tasks to the cloud
&gt; <i>For all of this generative AI stuff, for anything that actually has to use AI to create things like the AI Wallpaper making, the Magic Editor needs a permanent internet connection... It feels so sluggish, that you are constantly reminded that it&#x27;s not running on-device...</i><p>This is fine.<p>Generative AI has gotten good by being beastly huge, consuming gobs of resources. It&#x27;s not particularly fast even on &gt;$1000 consumer GPUs.<p>It feels like it would be an enormous waste of time and effort to try to scale these generative tasks down to small on-device footprints, where they can fit and run in reasonable time, knowing how much worse the results would be.<p>I don&#x27;t see what the alternative is here. But it certainly does leave the question open of what exactly are the great tensor tasks for the edge. With chipmaker like AMD and Qualcomm and ARM all putting on sizable neural&#x2F;tensor cores too, the question is a somewhat concerning one.