Answers.Body: <h1>TL;DR</h1>
  
  <p>Yes for all the 3 cases </p>
  
  <h1>Details</h1>
  
  <h2>VR</h2>
  
  <p>Even if the environment is virtual there is another thing to perceive which or better who is real: the user </p>
  
  <p>Deep Learning can be used for things like: eye tracking, gesture recognition, voice recognition, ... </p>
  
  <p>Furthermore, in games,  you could think about more complex applications like understanding the way the user plays the game and react accordingly </p>
  
  <h2>AR and MR</h2>
  
  <p>In addition to what has been said for VR, in these cases you also have to integrate the environment in the final user experience so you ultimately have to perceive it and there multiple specific applications: object detection, planes detection, depth estimation, Visual Odometry (e.g. as feature detection module), SLAM, ... </p>
  
  <p>These days Deep Learning is achieving Starte-Of-The-Art (SOTA) in many different tasks far beyond the classification and detection, but one things is research so published papers and so on and another thing is a product 
  so to sum up every VR, MR, AR vendor is probably relying on an hybrid solution where traditional algorithms and deep learning coexist but so far it seems the trend is deep learning is eating the traditional algos up day after day </p>
  
  <h1>References</h1>
  
  <p><a href="https://www.logikk.com/articles/deep-learning-in-vr-and-ar/" rel="nofollow noreferrer">The rising force of deep learning in VR and AR</a></p>
  
  <p><a href="https://www.smartdatacollective.com/virtual-reality-machine-learning-go-hand-in-hand/" rel="nofollow noreferrer">Virtual Reality And Machine Learning Go Hand In Hand</a></p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2019-06-01T07:29:10.387Z
Answers.Text: Thanks for the answer. What are modyle and SOTA?
Answers.UserDisplayName: Lei Xun
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2019-06-01T08:53:10.390Z
Answers.Text: Hi @LeiXun, thanks for spotting typos and not clear parts: I have edited my answer accordingly (SOTA = State of the Art which means the best performance it is possible to achieve today with science and technology, so not cheating :))
Answers.UserDisplayName: Nicola Bernini
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2019-05-31T18:31:24.590Z
Answers.LastActivityDate: 2019-06-01T08:51:29.830Z
Answers.LastEditDate: 2019-06-01T08:51:29.830Z
Answers.UserDisplayName: Nicola Bernini
Answers.Body: <p>Certainly in Virtual Reality the new Deep Convolutional Neural Networks algorithms applied in image processing are playing a role! Object detection, segmentation and semantic imaging are all features of these new ways of image processing. Augmented Reality then uses some advanced Optics features to accomplish its job. And so on...</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2019-06-03T17:49:15.723Z
Answers.Text: Welcome to SE:AI!  This answer could use some links to support it.
Answers.UserDisplayName: DukeZhou
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2019-06-01T12:27:06.847Z
Answers.LastActivityDate: 2019-06-01T12:27:06.847Z
Answers.UserDisplayName: Nuno Edgar Fernandes
Body: <p>I wonder if Virtual Reality (VR), Augmented Reality (AR) and Mixed Reality (MR) use any machine learning or deep learning?</p>
  
  <p>For example in AR, the virtual objects are brought into the real world, does this process involve any object detection and localization?</p>
  
Tags: <machine-learning><deep-learning><applications>
Title: Do VR, AR and MR use any machine learning or deep learning?
UserDisplayName: Lei Xun
ThreadText: # Do VR, AR and MR use any machine learning or deep learning?
  
  (Asked by: username_0 on 2019-05-31)
  
  I wonder if Virtual Reality (VR), Augmented Reality (AR) and Mixed Reality (MR) use any machine learning or deep learning?
  
  For example in AR, the virtual objects are brought into the real world, does this process involve any object detection and localization?
  
  **Tags:** machine-learning, deep-learning, applications
  
  ---
  
  ## 2 answers
  
  ### Answer by username_1 on 2019-05-31. Score: 0 | Accepted answer
  
  # TL;DR
  
  Yes for all the 3 cases
  
  # Details
  
  ## VR
  
  Even if the environment is virtual there is another thing to perceive which or better who is real: the user
  
  Deep Learning can be used for things like: eye tracking, gesture recognition, voice recognition, ...
  
  Furthermore, in games, you could think about more complex applications like understanding the way the user plays the game and react accordingly
  
  ## AR and MR
  
  In addition to what has been said for VR, in these cases you also have to integrate the environment in the final user experience so you ultimately have to perceive it and there multiple specific applications: object detection, planes detection, depth estimation, Visual Odometry (e.g. as feature detection module), SLAM, ...
  
  These days Deep Learning is achieving Starte-Of-The-Art (SOTA) in many different tasks far beyond the classification and detection, but one things is research so published papers and so on and another thing is a product
  so to sum up every VR, MR, AR vendor is probably relying on an hybrid solution where traditional algorithms and deep learning coexist but so far it seems the trend is deep learning is eating the traditional algos up day after day
  
  # References
  
  [The rising force of deep learning in VR and AR](https://www.logikk.com/articles/deep-learning-in-vr-and-ar/)
  
  [Virtual Reality And Machine Learning Go Hand In Hand](https://www.smartdatacollective.com/virtual-reality-machine-learning-go-hand-in-hand/)
  
  > **Comments:**
  > **username_0**: Thanks for the answer. What are modyle and SOTA?  
  > **username_1**: Hi @LeiXun, thanks for spotting typos and not clear parts: I have edited my answer accordingly (SOTA = State of the Art which means the best performance it is possible to achieve today with science and technology, so not cheating :))  
  
  ---
  
  ### Answer by username_2 on 2019-06-01. Score: 0
  
  Certainly in Virtual Reality the new Deep Convolutional Neural Networks algorithms applied in image processing are playing a role! Object detection, segmentation and semantic imaging are all features of these new ways of image processing. Augmented Reality then uses some advanced Optics features to accomplish its job. And so on...
  
  > **Comments:**
  > **username_3**: Welcome to SE:AI!  This answer could use some links to support it.  
  
  ---
  
  