The physical process that powers a new type of generative AI
This reminds me of Boltzmann Machines:<p><a href="https:&#x2F;&#x2F;www.mygreatlearning.com&#x2F;blog&#x2F;understanding-boltzmann-machines&#x2F;" rel="nofollow noreferrer">https:&#x2F;&#x2F;www.mygreatlearning.com&#x2F;blog&#x2F;understanding-boltzmann...</a><p><a href="https:&#x2F;&#x2F;medium.com&#x2F;@neuralnets&#x2F;boltzmann-machines-transformation-of-unsupervised-deep-learning-part-1-42659a74f530" rel="nofollow noreferrer">https:&#x2F;&#x2F;medium.com&#x2F;@neuralnets&#x2F;boltzmann-machines-transforma...</a><p>I&#x27;m having trouble finding a good introduction, but if I remember correctly, BMs started with the premise that nerves that fire together wire together. It can be easier to visualize that process than to think about gradient descent.<p>Since all NNs can be reduced to a matrix taking an input vector and returning an output vector, I think we often get lost in the weeds arguing about the merits of various types. IMHO it&#x27;s more useful to compare different classes of machine learning instead.<p>Honestly LLMs have strayed so far from what I thought was going to happen back in the late 90s that I&#x27;m still not sure how I feel about all of this. I think that our brains evolved more like an ant colony or mycelium in a forest, where countless small individuals form ever-more complex networks through mutual aid and evolution. What we think of as consciousness is already present in everything and the network happens to reach a level of complexity high enough for that source to interact with our 3D universe (like a radio antenna). Computing clusters could have achieved that decades ago but we went with SIMD video cards that can only run one algorithm per agent, not MIMD which could evolve each agent individually and run say 100 billion agents simultaneously like the neurons in our brain.<p>And the fact that AI is going in a SAAS&#x2F;subscription direction really concerns me. I don&#x27;t know if there&#x27;s time now to try these other algorithms before 1 or 2 companies dominate the industry under some kind of New World Order. Maybe it&#x27;s just me though hah.