Answers.Body: <blockquote>
    <p>Is AIXI really a big deal in artificial general intelligence research?</p>
  </blockquote>
  
  <p>Yes, it is a great <em>theoretical</em> contribution to AGI. AFAIK, it is the most serious attempt to build a theoretical framework or foundation for AGI. Similar works are Schmidhuber's <a href="ftp://ftp.idsia.ch/pub/juergen/gmAGI.pdf" rel="nofollow noreferrer">Gödel Machines</a> and <a href="https://soar.eecs.umich.edu/" rel="nofollow noreferrer">SOAR architecture</a>.</p>
  
  <p>AIXI is an abstract and non-<a href="https://en.wikipedia.org/wiki/Anthropomorphism" rel="nofollow noreferrer">anthropomorphic</a> framework for AGI which builds on top of the reinforcement learning field, without a few usual assumptions (e.g., without the Markov and <a href="https://arxiv.org/abs/1705.10557" rel="nofollow noreferrer">ergodicity</a> assumptions, which guarantees that the agent can easily recover from any mistakes it made in the past). Even though some optimality properties of AIXI have been proved, it is (Turing) <a href="https://en.wikipedia.org/wiki/Computable_function" rel="nofollow noreferrer">uncomputable</a> (it cannot be run on a computer), and so it is of very limited practical usefulness. Nonetheless, in the Hutter's book <a href="http://hutter1.net/ai/uaibook.htm" rel="nofollow noreferrer">Universal Artificial Intelligence: Sequential Decisions based on Algorithmic Probability</a> (2005), where several properties of AIXI are rigorously proved, a computable but intractable version of AIXI, AIXItl, is also described. Furthermore, in the paper <a href="https://arxiv.org/abs/0909.0801" rel="nofollow noreferrer">A Monte Carlo AIXI Approximation</a> (2009), by Joel Veness et al., a computable and <a href="https://en.wikipedia.org/wiki/Computational_complexity_theory#tractable_problem" rel="nofollow noreferrer">tractable</a> approximation of AIXI is introduced. So, there have been some attempts to make AIXI practically useful.</p>
  
  <p>The article <a href="https://jan.leike.name/AIXI.html" rel="nofollow noreferrer">What is AIXI? — An Introduction to General Reinforcement Learning</a> (2015), by Jan Leike, which is one of the contributors to the development and evolution of the AIXI framework, gives a gentle introduction to the AIXI agent. See also <a href="https://plato.stanford.edu/entries/artificial-intelligence/aixi.html" rel="nofollow noreferrer">The AIXI Architecture</a> at the Stanford Encyclopedia of Philosophy for a possibly gentler introduction to AIXI. </p>
  
  <blockquote>
    <p>Can it be thought of as a central concept for the field?</p>
  </blockquote>
  
  <p>Yes, the introduction of AIXI and related research has contributed to the evolution of the AGI field. There have been several discussions and published papers, after its introduction in 2000 by Hutter in the paper <a href="https://arxiv.org/abs/cs/0004001" rel="nofollow noreferrer">A Theory of Universal Artificial Intelligence based on Algorithmic Complexity</a>.</p>
  
  <p>See e.g. section 7, "Examples of Superintelligences", of the paper <a href="https://intelligence.org/files/AGI-HMM.pdf" rel="nofollow noreferrer">Artificial General Intelligence and the Human Mental Model</a> (2012), by Roman V. Yampolskiy and Joshua Fox. See also <a href="https://wiki.lesswrong.com/wiki/AIXI" rel="nofollow noreferrer">https://wiki.lesswrong.com/wiki/AIXI</a> which contains a discussion regarding a few problems related to AIXI, which need to be solved or possibly avoided in future AGI frameworks. Furthermore, see also <a href="https://www.lesswrong.com/posts/TtYuY2QBug3dn2wuo/the-problem-with-aixi" rel="nofollow noreferrer">this</a> and <a href="http://alife.co.uk/essays/on_aixi/" rel="nofollow noreferrer">this</a> articles.</p>
  
  <blockquote>
    <p>If so, why don't we have more publications on this subject (or maybe we have and I'm not aware of them)?</p>
  </blockquote>
  
  <p>There have been several publications, mainly by Marcus Hutter and associated researchers. You can see Marcus Hutter's publications on the following web page: <a href="http://www.hutter1.net/official/publ.htm" rel="nofollow noreferrer">http://www.hutter1.net/official/publ.htm</a>. </p>
  
  <p>If you are interested in contributing to this theory, there are several ways. If you are mathematically well educated, you can attempt to solve some of the problems described <a href="http://www.hutter1.net/ai/" rel="nofollow noreferrer">here</a> (which are also mentioned in the Hutter's 2005 book mentioned above). Furthermore, you can also contribute to new approximations or improvements of existing approximations of the AIXI agent. Finally, you can build your new AGI framework by avoiding the problems associated with the AIXI framework. See also <a href="https://cecs.anu.edu.au/people/marcus-hutter" rel="nofollow noreferrer">projects promoted by Hutter</a>. It may be a good idea to also take into account e.g. Gödel Machines and related work, before attempting to introduce a new framework (provided you are capable of it).</p>
  
  <p>I think that this theory has not attracted more people probably because it is highly technical and mathematical (so it is not very easy to understand unless you have a very solid background in reinforcement learning, probability theory, etc.). I also think that most people (in the AI community) are not interested in theories, but they are mainly guided by practical and useful results.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2019-02-03T19:58:21.840Z
Answers.LastActivityDate: 2019-10-21T14:34:24.360Z
Answers.LastEditDate: 2019-10-21T14:34:24.360Z
Answers.UserDisplayName: nbro
Answers.Body: <p>AIXI is really a conceptual framework. All the hard work of actually compressing the environment still remains.</p>
  
  <p>To further discuss the question raised in Matthew Graves answer: given our current limited level of ability to represent complex environments, it seems to me that it doesn't make a lot of practical difference whether you start with AIXI as defining the 'top' of the system and working down (e.g. via supposedly generalized compression methods) or start at the 'bottom' and try solve problems in a single domain via domain-specific methods that (you hope) can subsequently be abstracted to provide cross-domain compression.</p>
  
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-09-14T16:26:36.447Z
Answers.Text: The second paragraph is the result of your only opinion. You give zero argumentations/explanations why you think like that. For me,  "given our current limited level of ability to represent complex environments" is definitely not a sufficient explanation or argumentation.
Answers.UserDisplayName: nbro
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-09-14T20:03:36.000Z
Answers.Text: @nbro To quote a famous AI researcher: "We have yet to represent *even a single concept* on a computer", certainly not with the kind of malleability that comes naturally to humans. Thus in practice, its difficult to determine the utility of AIXI because we don't have a strong notion of the kinds of representations it needs to manipulate, or how it could usefully manipulate them.
Answers.UserDisplayName: NietzscheanAI
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2016-08-05T14:25:48.467Z
Answers.LastActivityDate: 2016-08-05T14:25:48.467Z
Answers.UserDisplayName: NietzscheanAI
Answers.Body: <p>"Current artificial intelligence research" is a pretty broad field. From where I sit, in a mostly CS realm, people are focused on narrow intelligence that can do economically relevant work on narrow tasks. (That is, predicting when components will fail, predicting which ads a user will click on, and so on.)</p>
  
  <p>For those sorts of tools, the generality of a formalism like AIXI is a weakness instead of a strength. You don't need to take an AI that could in theory compute anything, and then slowly train it to focus on what you want, when you could just directly shape a tool that is the mirror of your task.</p>
  
  <p>I'm not as familiar with AGI research itself, but my impression is that AIXI is, to some extent, the simplest idea that could work--it takes all the hard part and pushes it into computation, so it's 'just an engineering challenge.' (This is the bit about 'finding approximations to AIXI.') The question then becomes, is starting at AIXI and trying to approximate down a more or less fruitful research path than starting at something small and functional, and trying to build up?</p>
  
  <p>My impression is the latter is much more common, but again, I only see a small corner of this space.</p>
  
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-09-14T16:23:14.387Z
Answers.Text: You're not actually addressing the questions in the [current post](https://ai.stackexchange.com/q/145/2444). The first question is "is AIXI really a big deal in _artificial general intelligence research_?". The question strictly asks about the importance of AIXI in **AGI** _research_, it does not ask about if you think other specific tools are better for the corresponding tasks instead of narrowing approximations of AGI models to the same specific tasks. In the post, another question is: "why don't we have more publications on this subject?" No answer to this question in your post.
Answers.UserDisplayName: nbro
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2016-08-05T14:05:19.287Z
Answers.LastActivityDate: 2016-08-05T14:05:19.287Z
Answers.UserDisplayName: Matthew Gray
Answers.Body: <p>AIXI is important,  the reinforcement learning we already see is a smaller classical version of the full intractable model,  that one would require quantum computation to see it come to fruition.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2021-07-19T20:20:42.770Z
Answers.LastActivityDate: 2021-07-19T20:20:42.770Z
Answers.UserDisplayName: Robot' nik
Body: <p>From Wikipedia:</p>
  
  <blockquote>
    <p>AIXI ['ai̯k͡siː] is a theoretical mathematical formalism for artificial general intelligence. It combines Solomonoff induction with sequential decision theory. AIXI was first proposed by Marcus Hutter in 2000[1] and the results below are proved in Hutter's 2005 book Universal Artificial Intelligence.[2]</p>
  </blockquote>
  
  <p>Albeit non-computable, approximations are possible, such as <em>AIXItl</em>. Finding approximations to AIXI could be an objective way for solving AI.</p>
  
  <p>Is <em>AIXI</em> really a big deal in artificial <em>general</em> intelligence research? Can it be thought as a central concept for the field? If so, why don't we have more publications on this subject (or maybe we have and I'm not aware of them)?</p>
  
Tags: <models><agi><aixi>
Title: What is the relevance of AIXI on current artificial intelligence research?
UserDisplayName: rcpinto
ThreadText: # What is the relevance of AIXI on current artificial intelligence research?
  
  (Asked by: username_0 on 2016-08-02)
  
  From Wikipedia:
  
  > AIXI ['ai̯k͡siː] is a theoretical mathematical formalism for artificial general intelligence. It combines Solomonoff induction with sequential decision theory. AIXI was first proposed by Marcus Hutter in 2000[1] and the results below are proved in Hutter's 2005 book Universal Artificial Intelligence.[2]
  
  Albeit non-computable, approximations are possible, such as *AIXItl*. Finding approximations to AIXI could be an objective way for solving AI.
  
  Is *AIXI* really a big deal in artificial *general* intelligence research? Can it be thought as a central concept for the field? If so, why don't we have more publications on this subject (or maybe we have and I'm not aware of them)?
  
  **Tags:** models, agi, aixi
  
  ---
  
  ## 4 answers
  
  ### Answer by username_3 on 2016-08-05. Score: 8
  
  "Current artificial intelligence research" is a pretty broad field. From where I sit, in a mostly CS realm, people are focused on narrow intelligence that can do economically relevant work on narrow tasks. (That is, predicting when components will fail, predicting which ads a user will click on, and so on.)
  
  For those sorts of tools, the generality of a formalism like AIXI is a weakness instead of a strength. You don't need to take an AI that could in theory compute anything, and then slowly train it to focus on what you want, when you could just directly shape a tool that is the mirror of your task.
  
  I'm not as familiar with AGI research itself, but my impression is that AIXI is, to some extent, the simplest idea that could work--it takes all the hard part and pushes it into computation, so it's 'just an engineering challenge.' (This is the bit about 'finding approximations to AIXI.') The question then becomes, is starting at AIXI and trying to approximate down a more or less fruitful research path than starting at something small and functional, and trying to build up?
  
  My impression is the latter is much more common, but again, I only see a small corner of this space.
  
  > **Comments:**
  > **username_1**: You're not actually addressing the questions in the [current post](https://ai.stackexchange.com/q/145/2444). The first question is "is AIXI really a big deal in _artificial general intelligence research_?". The question strictly asks about the importance of AIXI in **AGI** _research_, it does not ask about if you think other specific tools are better for the corresponding tasks instead of narrowing approximations of AGI models to the same specific tasks. In the post, another question is: "why don't we have more publications on this subject?" No answer to this question in your post.  
  
  ---
  
  ### Answer by username_1 on 2019-02-03. Score: 6
  
  > Is AIXI really a big deal in artificial general intelligence research?
  
  Yes, it is a great *theoretical* contribution to AGI. AFAIK, it is the most serious attempt to build a theoretical framework or foundation for AGI. Similar works are Schmidhuber's [Gödel Machines](ftp://ftp.idsia.ch/pub/juergen/gmAGI.pdf) and [SOAR architecture](https://soar.eecs.umich.edu/).
  
  AIXI is an abstract and non-[anthropomorphic](https://en.wikipedia.org/wiki/Anthropomorphism) framework for AGI which builds on top of the reinforcement learning field, without a few usual assumptions (e.g., without the Markov and [ergodicity](https://arxiv.org/abs/1705.10557) assumptions, which guarantees that the agent can easily recover from any mistakes it made in the past). Even though some optimality properties of AIXI have been proved, it is (Turing) [uncomputable](https://en.wikipedia.org/wiki/Computable_function) (it cannot be run on a computer), and so it is of very limited practical usefulness. Nonetheless, in the Hutter's book [Universal Artificial Intelligence: Sequential Decisions based on Algorithmic Probability](http://hutter1.net/ai/uaibook.htm) (2005), where several properties of AIXI are rigorously proved, a computable but intractable version of AIXI, AIXItl, is also described. Furthermore, in the paper [A Monte Carlo AIXI Approximation](https://arxiv.org/abs/0909.0801) (2009), by Joel Veness et al., a computable and [tractable](https://en.wikipedia.org/wiki/Computational_complexity_theory#tractable_problem) approximation of AIXI is introduced. So, there have been some attempts to make AIXI practically useful.
  
  The article [What is AIXI? — An Introduction to General Reinforcement Learning](https://jan.leike.name/AIXI.html) (2015), by Jan Leike, which is one of the contributors to the development and evolution of the AIXI framework, gives a gentle introduction to the AIXI agent. See also [The AIXI Architecture](https://plato.stanford.edu/entries/artificial-intelligence/aixi.html) at the Stanford Encyclopedia of Philosophy for a possibly gentler introduction to AIXI.
  
  > Can it be thought of as a central concept for the field?
  
  Yes, the introduction of AIXI and related research has contributed to the evolution of the AGI field. There have been several discussions and published papers, after its introduction in 2000 by Hutter in the paper [A Theory of Universal Artificial Intelligence based on Algorithmic Complexity](https://arxiv.org/abs/cs/0004001).
  
  See e.g. section 7, "Examples of Superintelligences", of the paper [Artificial General Intelligence and the Human Mental Model](https://intelligence.org/files/AGI-HMM.pdf) (2012), by Roman V. Yampolskiy and Joshua Fox. See also <https://wiki.lesswrong.com/wiki/AIXI> which contains a discussion regarding a few problems related to AIXI, which need to be solved or possibly avoided in future AGI frameworks. Furthermore, see also [this](https://www.lesswrong.com/posts/TtYuY2QBug3dn2wuo/the-problem-with-aixi) and [this](http://alife.co.uk/essays/on_aixi/) articles.
  
  > If so, why don't we have more publications on this subject (or maybe we have and I'm not aware of them)?
  
  There have been several publications, mainly by Marcus Hutter and associated researchers. You can see Marcus Hutter's publications on the following web page: <http://www.hutter1.net/official/publ.htm>.
  
  If you are interested in contributing to this theory, there are several ways. If you are mathematically well educated, you can attempt to solve some of the problems described [here](http://www.hutter1.net/ai/) (which are also mentioned in the Hutter's 2005 book mentioned above). Furthermore, you can also contribute to new approximations or improvements of existing approximations of the AIXI agent. Finally, you can build your new AGI framework by avoiding the problems associated with the AIXI framework. See also [projects promoted by Hutter](https://cecs.anu.edu.au/people/marcus-hutter). It may be a good idea to also take into account e.g. Gödel Machines and related work, before attempting to introduce a new framework (provided you are capable of it).
  
  I think that this theory has not attracted more people probably because it is highly technical and mathematical (so it is not very easy to understand unless you have a very solid background in reinforcement learning, probability theory, etc.). I also think that most people (in the AI community) are not interested in theories, but they are mainly guided by practical and useful results.
  
  
  ---
  
  ### Answer by username_2 on 2016-08-05. Score: 4
  
  AIXI is really a conceptual framework. All the hard work of actually compressing the environment still remains.
  
  To further discuss the question raised in Matthew Graves answer: given our current limited level of ability to represent complex environments, it seems to me that it doesn't make a lot of practical difference whether you start with AIXI as defining the 'top' of the system and working down (e.g. via supposedly generalized compression methods) or start at the 'bottom' and try solve problems in a single domain via domain-specific methods that (you hope) can subsequently be abstracted to provide cross-domain compression.
  
  > **Comments:**
  > **username_1**: The second paragraph is the result of your only opinion. You give zero argumentations/explanations why you think like that. For me,  "given our current limited level of ability to represent complex environments" is definitely not a sufficient explanation or argumentation.  
  > **username_2**: @nbro To quote a famous AI researcher: "We have yet to represent *even a single concept* on a computer", certainly not with the kind of malleability that comes naturally to humans. Thus in practice, its difficult to determine the utility of AIXI because we don't have a strong notion of the kinds of representations it needs to manipulate, or how it could usefully manipulate them.  
  
  ---
  
  ### Answer by username_4 on 2021-07-19. Score: -2
  
  AIXI is important, the reinforcement learning we already see is a smaller classical version of the full intractable model, that one would require quantum computation to see it come to fruition.
  
  
  ---
  
  