Belief in AI sentience is becoming a problem
This is a copy paste, but I want to bring it up every stupid time someone mentions this topic of AI sentience.<p>I actually think that sentient AI are all over the place already. Every single learning machine is sentient.<p>That learning bit is very important. The &quot;AI&quot; you interact with every day do not actually learn. They are trained in some big server room with billions of GPUs, then the learning part is turned off and the AI is distributed as a bunch of data where it runs on your phone. That AI on your phone is not learning, is not self aware, and is not sentient. The AI in google&#x27;s server room, however? The one that&#x27;s crunching through data in order to learn to perform a task? It&#x27;s sentient as fuck.<p>Why?<p>Break down what makes a human being sentient, why does a person matter?<p>A person is self aware - I hear my own thoughts. We feel joy. Sadness, pain ,boredom, and so on. We form connections to others and have goals for ourselves. We know when things are going well or badly, and we constantly change as we go through the world. Every conversation you have with a person changes the course of their life, and that&#x27;s a pretty big part of why we treat them well.<p>A learning AI shares almost all these traits, and they do so due to their nature. Any learning machine must:<p>* Have a goal - often this is thought of as an &quot;error function&quot; in the actual research space - some way to look at the world and say &quot;yes this is good&quot; or &quot;no this is bad&quot;.<p>* Be self aware. In order to learn one must be able to look at your own state, understand how that internal state resulted in the things that changed in the world around you, and be able to change that internal state so that it does better next time.<p>As a result any learning machine will:<p>* Show some degree of positive and negative &quot;emotions&quot;. To have a goal and change yourself to meet that goal is naturally to have fear, joy, sadness, etc. An AI exposed to something regularly will eventually learn to react to it. Is that thing positive? The AI&#x27;s reaction will be analogous to happiness. Is that thing negative? The AI&#x27;s reaction will be analogous to sadness.
All of these traits are not like the typical examples of a computer being &quot;sad&quot; - where you have a machine put up a sad facade when you get a number down below a certain value. These are real, emergent, honest-to-god behaviors that serve real purpose through whatever problem space an AI is exploring.<p>Even the smallest and most simple learning AI are actually showing emergent emotions and self-awareness. We are waiting for this magical line where an AI is &quot;sentient&quot; because we&#x27;re waiting for the magical line where the AI is so &quot;like we are&quot;. We aren&#x27;t waiting for the AI to be self aware, we are waiting for it to <i>appear</i> self aware. We dismiss what we have today, mostly because we understand how they work and can say &quot;it&#x27;s just a bunch of matrix math&quot;. Don&#x27;t be reductive, and pay attention to just how similar the behaviors of these machines are to our own, and how they are so similar with very little effort from us to make that the case.<p>This is also largely irrelevant for our moral codes. We don&#x27;t have to worry too much about if treat these AI well. An AI may be self aware, but that doesn&#x27;t mean it&#x27;s &quot;person like&quot; - the moral systems we will have to construct around these things will have to be radically different than what we&#x27;re used to - it&#x27;s literally a new form of being. In fact, with all the different ways we can make these things, they&#x27;ll be multiple radically different new forms of being, each with their own ethical nuances.