"<a href=""https://www.youtube.com/watch?v=Gfr50f6ZBvo&amp;t=1h39m52s"">1:39:52</a> Lex asks about consciousness", but examplifies it with qualia (sense of taste, color). A system can be conscious (self-aware and able to reason and decide about one's own states and actions), but not sentient (feeling qualia). IMO, sentience arises as feedback loops to natural selection... On the other hand, RL is like natural selection, so, perhaps systems trained with RL, or evolutionary approaches, will eventually evolve sentience (as a thought-triggered global state modulations) too.