GPT-J-6B – A 6 billion parameter, autoregressive text generation model
Appreciate the enthusiasm! Mind doing some ELI5 for a (what feels like dinosaur-aged) hacker in his mid thirties who kinda missed the last decade of ML but is very curious?<p>&gt; That blog post I just linked to is running off of a TPU right now. Because it&#x27;s literally just an ubuntu server.<p>It&#x27;s not literally running on a TPU, is it? I assume it&#x27;s running on that Ubuntu server that has good ol&#x27; CPU that is running the web service + a TPU accelerator doing the number crunching. Or is my world view out of date?<p>&gt; The best part was, I was connected remotely to a TPU VM the whole time I was writing that notebook, via a jupyter server running on the TPU. Because, like I said, you can run whatever the hell you want on TPUs now<p>Again, I have some hesitations interpreting this literally. I assume what you&#x27;re saying is &quot;Google runs a Jupyter server somewhere in the cloud and it gives you access to TPU compute&quot;. I don&#x27;t think I could run, say, a Linux Desktop app with a GUI (falls under &quot;whatever the heck I want&quot;) on a TPU if I wanted to, correct? But, in case I could, how would I get that kind of direct &#x2F; low level access to it? Are they just giving you a pointer to your instance and you get complete control?