Answers.Body: <p>I think that the tasks you are referring to are the <a href="https://en.wikipedia.org/wiki/Simultaneous_localization_and_mapping" rel="nofollow noreferrer">Simultaneous localization and mapping</a> (SLAM) and, in particular, the <a href="https://en.wikipedia.org/wiki/Structure_from_motion" rel="nofollow noreferrer">Structure from Motion</a> (SfM).</p>
  
  <p>These methods are usually based on geometrical constraints and do not employ neural networks, but there exist some recent methods that make use of CNNs (such as <a href="http://www.luigifreda.com/2017/04/08/cnn-slam-real-time-dense-monocular-slam-learned-depth-prediction/" rel="nofollow noreferrer">this one</a>).</p>
  
  <p>Structure from Motion algorithms are a fundamental component of the <a href="https://developers.google.com/ar/" rel="nofollow noreferrer">Google ARCore</a> (former Project Tango) and the <a href="https://developer.apple.com/documentation/arkit" rel="nofollow noreferrer">Apple ARKit</a>.
  Unfortunately, these kits usually provide an interface to put elements in a specific position, but they don't provide the access to the 3d reconstruction of the scene.</p>
  
  <p>If you'd like to play with SfM algorithms, I suggest you to start from <a href="https://github.com/mapillary/OpenSfM" rel="nofollow noreferrer">this repository</a>, but you can find a lot of other valuable tutorials online.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2018-12-11T17:00:16.330Z
Answers.LastActivityDate: 2018-12-11T17:00:16.330Z
Answers.UserDisplayName: Stefano P.
Body: <p>To be honest, I had no idea where to put this question, but it's sure that it's related to AI. I want to build an application which uses camera, and by the movement it can calculate the
  -camera's position compared to the objects
  -the objects creator and edge points by the movement.</p>
  
  <p>What it means that if the camera is in a static position, it's just a picture. A set of coloured pixels. If we move the camera, we calculate the time, the gyroscope's values, but most importantly, we can have a comparison of two images taken by the same objects. This way:
  -we can detect the edges
  -from the edges, we can detect which is closer than the others</p>
  
  <p>Today's phone camera's are accurate enough to create ~60 crystal clear images per second, and it should be enough resource to accurately create high res models from just moving the camera according to some instructions (that's why I'm surprised why it isn't existing in just a phone app). Here comes the problem. I think the idea is worth for the try, but I'm just a JavaScript developer. The browser can have access to the camera, with TensorFlow I can use machine learning to detect edges, but if I want to be honest, I have no idea where to start, and how to continue step by step. Can you please provide me some guidelines how it would be ideal to create the idea?</p>
  
Tags: <machine-learning><deep-learning><mapping-space>
Title: How to use AI to depth map video?
UserDisplayName: Gergő Horváth
ThreadText: # How to use AI to depth map video?
  
  (Asked by: username_0 on 2018-12-10)
  
  To be honest, I had no idea where to put this question, but it's sure that it's related to AI. I want to build an application which uses camera, and by the movement it can calculate the
  -camera's position compared to the objects
  -the objects creator and edge points by the movement.
  
  What it means that if the camera is in a static position, it's just a picture. A set of coloured pixels. If we move the camera, we calculate the time, the gyroscope's values, but most importantly, we can have a comparison of two images taken by the same objects. This way:
  -we can detect the edges
  -from the edges, we can detect which is closer than the others
  
  Today's phone camera's are accurate enough to create ~60 crystal clear images per second, and it should be enough resource to accurately create high res models from just moving the camera according to some instructions (that's why I'm surprised why it isn't existing in just a phone app). Here comes the problem. I think the idea is worth for the try, but I'm just a JavaScript developer. The browser can have access to the camera, with TensorFlow I can use machine learning to detect edges, but if I want to be honest, I have no idea where to start, and how to continue step by step. Can you please provide me some guidelines how it would be ideal to create the idea?
  
  **Tags:** machine-learning, deep-learning, mapping-space
  
  
  ---
  
  ## 1 answers
  
  ### Answer by username_1 on 2018-12-11. Score: 3
  
  I think that the tasks you are referring to are the [Simultaneous localization and mapping](https://en.wikipedia.org/wiki/Simultaneous_localization_and_mapping) (SLAM) and, in particular, the [Structure from Motion](https://en.wikipedia.org/wiki/Structure_from_motion) (SfM).
  
  These methods are usually based on geometrical constraints and do not employ neural networks, but there exist some recent methods that make use of CNNs (such as [this one](http://www.luigifreda.com/2017/04/08/cnn-slam-real-time-dense-monocular-slam-learned-depth-prediction/)).
  
  Structure from Motion algorithms are a fundamental component of the [Google ARCore](https://developers.google.com/ar/) (former Project Tango) and the [Apple ARKit](https://developer.apple.com/documentation/arkit).
  Unfortunately, these kits usually provide an interface to put elements in a specific position, but they don't provide the access to the 3d reconstruction of the scene.
  
  If you'd like to play with SfM algorithms, I suggest you to start from [this repository](https://github.com/mapillary/OpenSfM), but you can find a lot of other valuable tutorials online.
  
  
  ---
  
  