Answers.Body: <p>Yes, there are different ways. What I think you are looking for is under the research field of Localization and Mapping. Which divides in the following subfields:
  <a href="https://i.sstatic.net/ROrlO.png" rel="nofollow noreferrer"><img src="https://i.sstatic.net/ROrlO.png" alt="enter image description here" /></a></p>
  <ul>
  <li>For getting current (the robot) position and trajectory go to models for Odometry Estimation</li>
  <li>For getting a representation of the world around the robot go to models for Mapping</li>
  <li>If you want <strong>both of them</strong> (I am guessing you want). Go for SLAM (Simultaneous Localization and Mapping) models</li>
  </ul>
  <p>Here it is the amazing survey that links you to tons of papers with different models for each category. If you want to know what are the most common architectural blocks (LSTM, ConvLSTM, RNN...) used for your problem, read the most promising papers under your target category.</p>
  <p>References:</p>
  <p>Survey: <a href="https://arxiv.org/abs/2006.12567" rel="nofollow noreferrer">https://arxiv.org/abs/2006.12567</a></p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2020-10-22T07:37:35.613Z
Answers.LastActivityDate: 2020-10-22T07:37:35.613Z
Answers.UserDisplayName: JVGD
Body: <p>Is there a common way to build a neural network that seeks to extract spatial and temporal information simultaneously? Is there an agreed up protocol on how to extract this information?</p>
  <p>What combination of layers works: convolution + LSTM? What would be the alternatives?</p>
  
Tags: <neural-networks><convolutional-neural-networks><recurrent-neural-networks><long-short-term-memory><multilayer-perceptrons>
Title: Is there a common way to build a neural network that seeks to extract spatial and temporal information simultaneously?
UserDisplayName: ADA
ThreadText: # Is there a common way to build a neural network that seeks to extract spatial and temporal information simultaneously?
  
  (Asked by: username_0 on 2020-10-21)
  
  Is there a common way to build a neural network that seeks to extract spatial and temporal information simultaneously? Is there an agreed up protocol on how to extract this information?
  
  What combination of layers works: convolution + LSTM? What would be the alternatives?
  
  **Tags:** neural-networks, convolutional-neural-networks, recurrent-neural-networks, long-short-term-memory, multilayer-perceptrons
  
  
  ---
  
  ## 1 answers
  
  ### Answer by username_1 on 2020-10-22. Score: 3 | Accepted answer
  
  Yes, there are different ways. What I think you are looking for is under the research field of Localization and Mapping. Which divides in the following subfields:
  [![enter image description here](https://i.sstatic.net/ROrlO.png)](https://i.sstatic.net/ROrlO.png)
  
  * For getting current (the robot) position and trajectory go to models for Odometry Estimation
  * For getting a representation of the world around the robot go to models for Mapping
  * If you want **both of them** (I am guessing you want). Go for SLAM (Simultaneous Localization and Mapping) models
  
  Here it is the amazing survey that links you to tons of papers with different models for each category. If you want to know what are the most common architectural blocks (LSTM, ConvLSTM, RNN...) used for your problem, read the most promising papers under your target category.
  
  References:
  
  Survey: <https://arxiv.org/abs/2006.12567>
  
  
  ---
  
  