Answers.Body: <blockquote>
    <p>(this was intended as a comment, but turned out long and longer)</p>
  </blockquote>
  
  <p>A couple of points to elaborate on <a href="https://ai.stackexchange.com/a/73/70">Ben's answer</a>:</p>
  
  <ul>
  <li>It is possible to generate different models (out of existing data!) and then look for the model that best fit new data (e.g. with <a href="https://en.wikipedia.org/wiki/K-nearest_neighbors_algorithm" rel="nofollow noreferrer">knn</a>). Example: 
  
  <ul>
  <li>States = {<em>sleep</em>, <em>eat</em>, <em>walk</em>, <em>work</em>}</li>
  <li>Model 1: Most probable sequence on weekdays, say: sleep → sleep → eat → walk → work → work → eat → walk → sleep  → sleep</li>
  <li>Model 2: Most probable sequence on weekends, some: sleep → sleep → eat → walk → eat → walk → sleep → sleep</li>
  <li>New data arrives: Which sequence is more probable that it came from? Check model 1, check model 2. Which fits better? → Assign</li>
  </ul></li>
  <li>Note that the previous example is oversimplified. Also note that a <em>unit time</em> is needed there (other than letters / words, for instance).</li>
  <li>You can <em>nest</em> Markov models. That means that you generate a model (a set of probabilities for all the states) in a "lower scale" and then use it in a more abstract model. For example, you can nest your day-scale model to a month or year (to include holidays, for instance).</li>
  </ul>
  
  <p>Also <a href="http://blog.wolfram.com/2013/02/04/centennial-of-markov-chains/" rel="nofollow noreferrer">see this link for a nice introduction</a> and <a href="https://stats.stackexchange.com/questions/tagged/mcmc?sort=votes&amp;pageSize=50">some posts in crossvalidated</a>.</p>
  
  <hr>
  
  <p>As for the question if artificial intelligence can be created by using this kind of methods, my personal (easy) answer would be <strong>no</strong>, because they only relate data and probabilities and thus belong more to the statistics and machine learning branch. </p>
  
  <p>A longer answer needs to take into account the <a href="https://ai.stackexchange.com/questions/74/what-is-the-difference-between-strong-ai-and-weak-ai">weak vs. strong AI question</a>.</p>
  
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2016-08-03T06:37:01.983Z
Answers.LastActivityDate: 2016-08-03T06:37:01.983Z
Answers.LastEditDate: 2017-04-13T12:53:10.013Z
Answers.UserDisplayName: Luis
Answers.Body: <p>A Markov model includes the probability of transitioning to each state considering the current state. "Each state" may be just one point - whether it rained on specific day, for instance - or it might look like multiple things - like a pair of words. You've probably seen automatically generated weird text that <em>almost</em> makes sense, like <a href="https://blog.codinghorror.com/markov-and-you/">Garkov</a> (the output of a Markov model based on the Garfield comic strips). That Coding Horror article also mentions the applications of Markov techniques to Google's PageRank.</p>
  
  <p>Markov models are really only powerful when they have a lot of input to work with. If a machine looked through a lot of English text, it would get a pretty good idea of what words generally come after other words. Or after looking through someone's location history, it could figure out where that person is likely to go next from a certain place. Constantly updating the "input corpus" as more data is received would let the machine tune the probabilities of all the state transitions.</p>
  
  <p>Genetic algorithms are fairly different things. They create functions by shuffling around parts of functions and seeing how good each function is at a certain task. A child algorithm will depend on its parents, but Markov models are interested mostly in predicting what thing will come next in a sequence, not creating a new chunk of code. You might be able to use a Markov model to spit out a candidate function, though, depending on how simple the "alphabet" is. You could even then give more weight to the transitions in successful algorithms.</p>
  
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2016-08-02T16:40:20.240Z
Answers.LastActivityDate: 2016-08-02T16:40:20.240Z
Answers.UserDisplayName: Ben N
Body: <p>I believe a Markov chain is a sequence of events where each subsequent event depends probabilistically on the current event.  What are examples of the application of a Markov chain and can it be used to create artificial intelligence?  Would a genetic algorithm be an example of a Markov chain since each generation depends upon the state of the prior generation?</p>
  
Tags: <genetic-algorithms><markov-chain><probability>
Title: What is a Markov chain and how can it be used in creating artificial intelligence?
UserDisplayName: WilliamKF
ThreadText: # What is a Markov chain and how can it be used in creating artificial intelligence?
  
  (Asked by: username_0 on 2016-08-02)
  
  I believe a Markov chain is a sequence of events where each subsequent event depends probabilistically on the current event. What are examples of the application of a Markov chain and can it be used to create artificial intelligence? Would a genetic algorithm be an example of a Markov chain since each generation depends upon the state of the prior generation?
  
  **Tags:** genetic-algorithms, markov-chain, probability
  
  ---
  
  ## 2 answers
  
  ### Answer by username_2 on 2016-08-02. Score: 10 | Accepted answer
  
  A Markov model includes the probability of transitioning to each state considering the current state. "Each state" may be just one point - whether it rained on specific day, for instance - or it might look like multiple things - like a pair of words. You've probably seen automatically generated weird text that *almost* makes sense, like [Garkov](https://blog.codinghorror.com/markov-and-you/) (the output of a Markov model based on the Garfield comic strips). That Coding Horror article also mentions the applications of Markov techniques to Google's PageRank.
  
  Markov models are really only powerful when they have a lot of input to work with. If a machine looked through a lot of English text, it would get a pretty good idea of what words generally come after other words. Or after looking through someone's location history, it could figure out where that person is likely to go next from a certain place. Constantly updating the "input corpus" as more data is received would let the machine tune the probabilities of all the state transitions.
  
  Genetic algorithms are fairly different things. They create functions by shuffling around parts of functions and seeing how good each function is at a certain task. A child algorithm will depend on its parents, but Markov models are interested mostly in predicting what thing will come next in a sequence, not creating a new chunk of code. You might be able to use a Markov model to spit out a candidate function, though, depending on how simple the "alphabet" is. You could even then give more weight to the transitions in successful algorithms.
  
  
  ---
  
  ### Answer by username_1 on 2016-08-03. Score: 2
  
  > (this was intended as a comment, but turned out long and longer)
  
  A couple of points to elaborate on [Ben's answer](https://ai.stackexchange.com/a/73/70):
  
  * It is possible to generate different models (out of existing data!) and then look for the model that best fit new data (e.g. with [knn](https://en.wikipedia.org/wiki/K-nearest_neighbors_algorithm)). Example:
    + States = {*sleep*, *eat*, *walk*, *work*}
    + Model 1: Most probable sequence on weekdays, say: sleep → sleep → eat → walk → work → work → eat → walk → sleep → sleep
    + Model 2: Most probable sequence on weekends, some: sleep → sleep → eat → walk → eat → walk → sleep → sleep
    + New data arrives: Which sequence is more probable that it came from? Check model 1, check model 2. Which fits better? → Assign
  * Note that the previous example is oversimplified. Also note that a *unit time* is needed there (other than letters / words, for instance).
  * You can *nest* Markov models. That means that you generate a model (a set of probabilities for all the states) in a "lower scale" and then use it in a more abstract model. For example, you can nest your day-scale model to a month or year (to include holidays, for instance).
  
  Also [see this link for a nice introduction](http://blog.wolfram.com/2013/02/04/centennial-of-markov-chains/) and [some posts in crossvalidated](https://stats.stackexchange.com/questions/tagged/mcmc?sort=votes&pageSize=50).
  
  ---
  
  As for the question if artificial intelligence can be created by using this kind of methods, my personal (easy) answer would be **no**, because they only relate data and probabilities and thus belong more to the statistics and machine learning branch.
  
  A longer answer needs to take into account the [weak vs. strong AI question](https://ai.stackexchange.com/questions/74/what-is-the-difference-between-strong-ai-and-weak-ai).
  
  
  ---
  
  