Answers.Body: <p>Whether all AI are goal-driven depends on how far you're willing to extend the definition of 'goal'.</p>
  
  <p>AIs are often defined through their primary tasks. Face recognition is a process; a face recognition AI is a limited, special-purpose AI. Paperclip collection is a process, the Paperclip Maximizer is a general, goal-driven AI.</p>
  
  <p>There will always be <em>some sort of goal</em>, but it may in certain cases become so nebulous it's really a stretch to continue calling it a goal. For example,  unsupervised learning (as suggested by Aiden Grossman) - the goal you set is "learn", with very little qualifiers. The underlying AI may develop in surprising and unexpected ways; it may even modify own goals.</p>
  
  <p>Similarly, another "aimless" AI type is a simulator of biological intelligence - say, replicating neural connections of an insect in software, making it run and observing the behaviors. The AI itself is not given a specific goal - it's a tool/subject of study, not something directly producing results. Still, the goals are exactly the same as goals of the original insect: feed, multiply, stay safe; unattainable due to hardware limitations but still pursued.</p>
  
  <p>Therefore, whether all AIs are goal-driven is arguable. The only AI that is not actually driven by any goal whatsoever is one that's switched off. But whether you consider all the possible nebulous, abstract or accidental goals that drive the AI to call it actually goal-driven, that's up to debate.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2020-03-06T01:16:05.390Z
Answers.Text: Comments are not for extended discussion; this conversation has been [moved to chat](https://chat.stackexchange.com/rooms/105239/discussion-on-answer-by-sf-what-other-kind-of-ais-exist-apart-from-goal-driven).
Answers.UserDisplayName: nbro
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-11-30T15:58:31.770Z
Answers.LastActivityDate: 2017-11-30T15:58:31.770Z
Answers.UserDisplayName: SF.
Answers.Body: <p>I suppose, the context was as follows: suppose you have AI for which goals cannot be described by a function. It doesn't mean it has no goals, but that formulation of the goals cannot be functionally dependent on known reality model parameters. 
  In this interpretation text which you cited has clear meaning: author doesn't want to discuss such kinds of object, which is reasonable.</p>
  
  <p>Such interpretation is interesting as well, because opens interesting cases to think about :)</p>
  
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-12-03T17:11:19.390Z
Answers.LastActivityDate: 2017-12-03T17:11:19.390Z
Answers.UserDisplayName: kakaz
Answers.Body: <p>Following the standard AI textbook, <em>Artificial Intelligence:  A modern approach</em>, other from goals based agents there are <strong>Reflex Agents, Model based Reflex agents, Model based Goal based agents, Utility agents and Learning agents.</strong></p>
  
  <p>Simple Reflex agents are based on condition action rules, kinda like If-then rule based agents.
  <a href="https://i.sstatic.net/0Vl4Y.jpg" rel="nofollow noreferrer"><img src="https://i.sstatic.net/0Vl4Y.jpg" alt="Reflex agents"></a></p>
  
  <p>Model based agents are whose which have a model of the world in it, I mean <em>how the world evolves and what my action will do</em>
  They are in two variants, Model based reflex agent and model based goal directed agent.
  <a href="https://i.sstatic.net/9kP6E.jpg" rel="nofollow noreferrer"><img src="https://i.sstatic.net/9kP6E.jpg" alt="Model based reflex agents"></a></p>
  
  <p>Former one percepts the environment, infer from that how the world evolves and figure out what their action will do then that have some conditon base rules which then lead to action, </p>
  
  <p><a href="https://i.sstatic.net/89zPC.jpg" rel="nofollow noreferrer"><img src="https://i.sstatic.net/89zPC.jpg" alt="Model based goal directed agents"></a>In latter type the module of conditon based rules are replaced by the module of goals, which can be kinda further broken into condition based rules,which they are literally.</p>
  
  <p><a href="https://i.sstatic.net/hdeyE.jpg" rel="nofollow noreferrer"><img src="https://i.sstatic.net/hdeyE.jpg" alt="Utility based agents"></a>
  Utility agents are reinforcement based agent they act in environment to maximize their utility, and have some element to check what the happiness measure or "Performance measure" is, the defintion of rational Agent is based on this, which is a rational agent will always act to maximize their average utility.</p>
  
  <p><a href="https://i.sstatic.net/Sy0w0.jpg" rel="nofollow noreferrer"><img src="https://i.sstatic.net/Sy0w0.jpg" alt="Learning agents"></a>
  Learning agent are which contain some kinda critics, some learning element and then problem generator, an isomorphism might be drawn from to Neural networks, which has their critics as Cost function, learning element as Wieght tuning.
  I have been saying "kinda" because they just seems to be metaphor to me.</p>
  
  <p>I dont know why Marcus hutler described goals agents as Utility based agents, probably he had some kinda hybrid of two.</p>
  
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-12-04T08:02:35.857Z
Answers.LastActivityDate: 2017-12-04T08:12:22.560Z
Answers.LastEditDate: 2017-12-04T08:12:22.560Z
Answers.UserDisplayName: xrfxlp
Answers.Body: <p>Interesting question.</p>
  
  <p><strong>Case One &mdash; Goals not Goal</strong></p>
  
  <p>When systems are developed, they are based on requirements.  The goals of the system is closely coupled to the goals of the development.  This is the first example.  Few systems and few development efforts to construct them are goal driven.  They are rather systems and processes that tend toward a set of goals.  Rarely is there a single loss function.</p>
  
  <p>Consider an animal.  It's metabolic stasis system may generate what seems like a goal, a set of signals to other systems to find and eat food.  At another time its temperature stasis system may generate what seems like a goal, a set of signals to other systems to build a shelter to enter.  The notion that there is some goal to survive is inconsistent with the way neurological and metabolic systems actually interact.  Survival, some would say, was the goal of the animal's evolution, but that is not technically true.  It survived, not because survival was a goal but because each of its ancestors survived as a result of transient and recurrent command signals for eating and sheltering.  There is no aggregate loss function.  There is no single neural pathway that all these signals are funneled through.  The animal's behavioral subsystems may share some components, but the mechanisms of intent are largely independent.  It only appears to a casual observer that the separate systems are collaborating toward survival.</p>
  
  <p>This is true of some vehicle automation systems.  Collision avoidance is a system with a set of goals and routing is a system with a separate set of goals.  The goals are decoupled even though they may share a CPU, vision systems, and a large number of functional components and computing resources.</p>
  
  <p>These systems are goals driven, using the plural, not goal driven.</p>
  
  <p><strong>Case Two &mdash; Process of Elimination</strong></p>
  
  <p>Another type of AI approach that is not technically goal driven are genetic algorithms.  They replicate and some of the replicants are eliminated, but the entities themselves have no goal.  The elimination criteria is not technically a goal.  It is the opposite of one.  The appearance of replicants that are not eliminated after many rounds of replication and concurrent narrowing of criteria may achieve some goal of the person running the algorithm, but the algorithm itself has no representation of a goal but rather its opposite, the final criteria of elimination in the last round.</p>
  
  <p><strong>Case Three &mdash; Experimental Apparatus</strong></p>
  
  <p>Many AI experiments to discover the nature of intelligence and ways to simulate aspects of intelligence have the external goal defined by the researcher, but the system used in the experiment, the AI apparatus, is not driven by a goal.  It runs goal-less.</p>
  
  <p><strong>Case Four &mdash; Toys</strong></p>
  
  <p>Whether toys for adults or kids, toys may arise with some goal in mind, to amuse in some way, but the AI within them has no goal.  There is no loss function to minimize or reinforcement or wellness signal to maximize.  It's behavior may be less amusing if it were goal driven.  What makes it amusing is its ability to produce patterns associated with intelligence, but to no particular purpose.  In some ways, much human conversation and creative art is like this.  Too much purpose, and the level of amusement decreases.</p>
  
  <p><strong>Case Five &mdash; Robots That Mimic Postmodern Humans</strong></p>
  
  <p>Humans in postmodern society, the ones that are truly relativists and have rejected modernism, are not particularly goal driven.  They tend to wander around and do things that are intelligent, however they may act goal directed and then destroy the product of the transient goal.  Building sand castles on the beach is an example.  Although this may not be the focus of current AI research, since there is so much hope placed in AI to do things for us, such does not exclude the possibility of future robots that build something and then destroy it to build something else, without some practical objective.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2018-11-24T19:26:50.280Z
Answers.LastActivityDate: 2018-11-24T19:26:50.280Z
Answers.UserDisplayName: Douglas Daseeco
Body: <p>Goal-driven AIs is the only kind of AI I am aware of. However, Marcus Hutter claims <a href="http://www.hutter1.net/ai/uaibook.htm" rel="nofollow noreferrer">the following</a></p>
  
  <blockquote>
    <p>Most, if not all known facets of intelligence can be formulated as goal driven or, more generally, as maximizing some utility function. It is, therefore, sufficient to study goal driven AI.</p>
  </blockquote>
  
  <p>which doesn't necessarily imply that there are other types of AIs (apart from goal-driven), but (at least, in the way it is phrased) suggests that there are other types of AIs. If there exist other types of AIs, which are they?</p>
  
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2020-03-06T01:16:38.060Z
Comments.Text: Comments are not for extended discussion; this conversation has been [moved to chat](https://chat.stackexchange.com/rooms/105240/discussion-on-question-by-nbro-what-other-kind-of-ais-exist-apart-from-goal-driv).
Comments.UserDisplayName: nbro
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2021-01-19T01:25:09.527Z
Comments.Text: I found the paper [Learning, Goals, and Learning Goals: A Perspective on Goal-Driven Learning](https://link.springer.com/content/pdf/10.1007/BF00849065.pdf) (1995) by Leake and Ram, which I have not yet the occasion to read, that may contain useful info to answer this question.
Comments.UserDisplayName: nbro
Tags: <agi><definitions><terminology>
Title: What other kind of AIs exist apart from goal-driven?
UserDisplayName: nbro
ThreadText: # What other kind of AIs exist apart from goal-driven?
  
  (Asked by: username_0 on 2017-11-29)
  
  Goal-driven AIs is the only kind of AI I am aware of. However, Marcus Hutter claims [the following](http://www.hutter1.net/ai/uaibook.htm)
  
  > Most, if not all known facets of intelligence can be formulated as goal driven or, more generally, as maximizing some utility function. It is, therefore, sufficient to study goal driven AI.
  
  which doesn't necessarily imply that there are other types of AIs (apart from goal-driven), but (at least, in the way it is phrased) suggests that there are other types of AIs. If there exist other types of AIs, which are they?
  
  **Tags:** agi, definitions, terminology
  
  > **Comments:**
  > **username_0**: Comments are not for extended discussion; this conversation has been [moved to chat](https://chat.stackexchange.com/rooms/105240/discussion-on-question-by-username_0-what-other-kind-of-ais-exist-apart-from-goal-driv).  
  > **username_0**: I found the paper [Learning, Goals, and Learning Goals: A Perspective on Goal-Driven Learning](https://link.springer.com/content/pdf/10.1007/BF00849065.pdf) (1995) by Leake and Ram, which I have not yet the occasion to read, that may contain useful info to answer this question.  
  
  ---
  
  ## 4 answers
  
  ### Answer by username_1 on 2017-11-30. Score: 4
  
  Whether all AI are goal-driven depends on how far you're willing to extend the definition of 'goal'.
  
  AIs are often defined through their primary tasks. Face recognition is a process; a face recognition AI is a limited, special-purpose AI. Paperclip collection is a process, the Paperclip Maximizer is a general, goal-driven AI.
  
  There will always be *some sort of goal*, but it may in certain cases become so nebulous it's really a stretch to continue calling it a goal. For example, unsupervised learning (as suggested by Aiden Grossman) - the goal you set is "learn", with very little qualifiers. The underlying AI may develop in surprising and unexpected ways; it may even modify own goals.
  
  Similarly, another "aimless" AI type is a simulator of biological intelligence - say, replicating neural connections of an insect in software, making it run and observing the behaviors. The AI itself is not given a specific goal - it's a tool/subject of study, not something directly producing results. Still, the goals are exactly the same as goals of the original insect: feed, multiply, stay safe; unattainable due to hardware limitations but still pursued.
  
  Therefore, whether all AIs are goal-driven is arguable. The only AI that is not actually driven by any goal whatsoever is one that's switched off. But whether you consider all the possible nebulous, abstract or accidental goals that drive the AI to call it actually goal-driven, that's up to debate.
  
  > **Comments:**
  > **username_0**: Comments are not for extended discussion; this conversation has been [moved to chat](https://chat.stackexchange.com/rooms/105239/discussion-on-answer-by-sf-what-other-kind-of-ais-exist-apart-from-goal-driven).  
  
  ---
  
  ### Answer by username_2 on 2017-12-03. Score: 1
  
  I suppose, the context was as follows: suppose you have AI for which goals cannot be described by a function. It doesn't mean it has no goals, but that formulation of the goals cannot be functionally dependent on known reality model parameters.
  In this interpretation text which you cited has clear meaning: author doesn't want to discuss such kinds of object, which is reasonable.
  
  Such interpretation is interesting as well, because opens interesting cases to think about :)
  
  
  ---
  
  ### Answer by username_3 on 2017-12-04. Score: 1
  
  Following the standard AI textbook, *Artificial Intelligence: A modern approach*, other from goals based agents there are **Reflex Agents, Model based Reflex agents, Model based Goal based agents, Utility agents and Learning agents.**
  
  Simple Reflex agents are based on condition action rules, kinda like If-then rule based agents.
  [![Reflex agents](https://i.sstatic.net/0Vl4Y.jpg)](https://i.sstatic.net/0Vl4Y.jpg)
  
  Model based agents are whose which have a model of the world in it, I mean *how the world evolves and what my action will do*
  They are in two variants, Model based reflex agent and model based goal directed agent.
  [![Model based reflex agents](https://i.sstatic.net/9kP6E.jpg)](https://i.sstatic.net/9kP6E.jpg)
  
  Former one percepts the environment, infer from that how the world evolves and figure out what their action will do then that have some conditon base rules which then lead to action,
  
  [![Model based goal directed agents](https://i.sstatic.net/89zPC.jpg)](https://i.sstatic.net/89zPC.jpg)In latter type the module of conditon based rules are replaced by the module of goals, which can be kinda further broken into condition based rules,which they are literally.
  
  [![Utility based agents](https://i.sstatic.net/hdeyE.jpg)](https://i.sstatic.net/hdeyE.jpg)
  Utility agents are reinforcement based agent they act in environment to maximize their utility, and have some element to check what the happiness measure or "Performance measure" is, the defintion of rational Agent is based on this, which is a rational agent will always act to maximize their average utility.
  
  [![Learning agents](https://i.sstatic.net/Sy0w0.jpg)](https://i.sstatic.net/Sy0w0.jpg)
  Learning agent are which contain some kinda critics, some learning element and then problem generator, an isomorphism might be drawn from to Neural networks, which has their critics as Cost function, learning element as Wieght tuning.
  I have been saying "kinda" because they just seems to be metaphor to me.
  
  I dont know why Marcus hutler described goals agents as Utility based agents, probably he had some kinda hybrid of two.
  
  
  ---
  
  ### Answer by username_4 on 2018-11-24. Score: 0
  
  Interesting question.
  
  **Case One — Goals not Goal**
  
  When systems are developed, they are based on requirements. The goals of the system is closely coupled to the goals of the development. This is the first example. Few systems and few development efforts to construct them are goal driven. They are rather systems and processes that tend toward a set of goals. Rarely is there a single loss function.
  
  Consider an animal. It's metabolic stasis system may generate what seems like a goal, a set of signals to other systems to find and eat food. At another time its temperature stasis system may generate what seems like a goal, a set of signals to other systems to build a shelter to enter. The notion that there is some goal to survive is inconsistent with the way neurological and metabolic systems actually interact. Survival, some would say, was the goal of the animal's evolution, but that is not technically true. It survived, not because survival was a goal but because each of its ancestors survived as a result of transient and recurrent command signals for eating and sheltering. There is no aggregate loss function. There is no single neural pathway that all these signals are funneled through. The animal's behavioral subsystems may share some components, but the mechanisms of intent are largely independent. It only appears to a casual observer that the separate systems are collaborating toward survival.
  
  This is true of some vehicle automation systems. Collision avoidance is a system with a set of goals and routing is a system with a separate set of goals. The goals are decoupled even though they may share a CPU, vision systems, and a large number of functional components and computing resources.
  
  These systems are goals driven, using the plural, not goal driven.
  
  **Case Two — Process of Elimination**
  
  Another type of AI approach that is not technically goal driven are genetic algorithms. They replicate and some of the replicants are eliminated, but the entities themselves have no goal. The elimination criteria is not technically a goal. It is the opposite of one. The appearance of replicants that are not eliminated after many rounds of replication and concurrent narrowing of criteria may achieve some goal of the person running the algorithm, but the algorithm itself has no representation of a goal but rather its opposite, the final criteria of elimination in the last round.
  
  **Case Three — Experimental Apparatus**
  
  Many AI experiments to discover the nature of intelligence and ways to simulate aspects of intelligence have the external goal defined by the researcher, but the system used in the experiment, the AI apparatus, is not driven by a goal. It runs goal-less.
  
  **Case Four — Toys**
  
  Whether toys for adults or kids, toys may arise with some goal in mind, to amuse in some way, but the AI within them has no goal. There is no loss function to minimize or reinforcement or wellness signal to maximize. It's behavior may be less amusing if it were goal driven. What makes it amusing is its ability to produce patterns associated with intelligence, but to no particular purpose. In some ways, much human conversation and creative art is like this. Too much purpose, and the level of amusement decreases.
  
  **Case Five — Robots That Mimic Postmodern Humans**
  
  Humans in postmodern society, the ones that are truly relativists and have rejected modernism, are not particularly goal driven. They tend to wander around and do things that are intelligent, however they may act goal directed and then destroy the product of the transient goal. Building sand castles on the beach is an example. Although this may not be the focus of current AI research, since there is so much hope placed in AI to do things for us, such does not exclude the possibility of future robots that build something and then destroy it to build something else, without some practical objective.
  
  
  ---
  
  