ChatGPT as a Calculator for Words
I&#x27;ve seen this take a lot, and I find it frustrating as it flies in the face of the information theory underpinning how large neural networks learn information.<p>This is more than just a fancy zip file of Markov sequences. Someone has got to put a stop to this silly line of reasoning, I&#x27;m not sure why more people familiar with the math of deep learning aren&#x27;t doing their best to dispel this particular belief (which people will then use as the foundation for other arguments, and so on, and so on, and this is how misconceptions somehow become canon in the larger body of work).