Body: <p>My question is very general and it does not originate from a specific problem. Let's assume that, through experience, we have learned that some statistical property of a set of data is important in predicting some behavior in a system. For example, for time series data <em>d1, d2, d3, ..., dn</em>, we heuristically know that the average of the last <em>n</em> steps denoted by <em>avg(d,n)</em> and the standard deviation of the last <em>m</em> denoted by <em>std(d,m)</em> are significant in prediction. Now my questions are:</p>
  <ol>
  <li><p>Should a machine learning system, let's say LSTM, or reinforcement learning agent, be fed the raw data or data with other statistical properties? I am asking this because, if the statistical derivatives are useful in training then there is no limit on how many statistical properties we can define and feed to the training process.</p>
  </li>
  <li><p>Do machine learning, again let's say LSTM, automatically learn about underlying statistics from just pure raw data?</p>
  </li>
  <li><p>How do we deal with different data of different scales and dimensions, for example, simple average is in the same scale as the raw data but standard deviation is of different scale and dimension and so on so forth?</p>
  </li>
  </ol>
  <p>I appreciate your comments.</p>
  
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2021-09-14T16:28:04.593Z
Comments.Text: Usually the point is that the system learns to approximate whatever calculations it needs.
Comments.UserDisplayName: Criticize SE actions means ban
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2021-09-14T21:57:35.257Z
Comments.Text: Hello, asking multiple questions in a single post is not recommended. Please try to split the questions into multiple posts.
Comments.UserDisplayName: hanugm
Tags: <neural-networks><machine-learning><deep-learning><long-short-term-memory><statistical-ai>
Title: Machine learning with raw data alone / or raw data with its statistics
UserDisplayName: user101464
ThreadText: # Machine learning with raw data alone / or raw data with its statistics
  
  (Asked by: username_0 on 2021-09-14)
  
  My question is very general and it does not originate from a specific problem. Let's assume that, through experience, we have learned that some statistical property of a set of data is important in predicting some behavior in a system. For example, for time series data *d1, d2, d3, ..., dn*, we heuristically know that the average of the last *n* steps denoted by *avg(d,n)* and the standard deviation of the last *m* denoted by *std(d,m)* are significant in prediction. Now my questions are:
  
  1. Should a machine learning system, let's say LSTM, or reinforcement learning agent, be fed the raw data or data with other statistical properties? I am asking this because, if the statistical derivatives are useful in training then there is no limit on how many statistical properties we can define and feed to the training process.
  2. Do machine learning, again let's say LSTM, automatically learn about underlying statistics from just pure raw data?
  3. How do we deal with different data of different scales and dimensions, for example, simple average is in the same scale as the raw data but standard deviation is of different scale and dimension and so on so forth?
  
  I appreciate your comments.
  
  **Tags:** neural-networks, machine-learning, deep-learning, long-short-term-memory, statistical-ai
  
  > **Comments:**
  > **username_1**: Usually the point is that the system learns to approximate whatever calculations it needs.  
  > **username_2**: Hello, asking multiple questions in a single post is not recommended. Please try to split the questions into multiple posts.  
  
  ---
  
  ## 0 answers
  
  