Answers.Body: <p>Yes, it is a very common practice to use some RNN when your input data is a sequence.
  Besides, your network has some shape issue if your input data is 2D. You should, at least flatten your input data to a vector to be able to forward propagate to the dense layer, but instead of this use some kind of RNN. 
  To the best of my knowledge, that dropout value doesn't good. It seems too low.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2018-05-23T16:49:16.463Z
Answers.Text: Thank you for helping. My training data is 1D and if I predict data using the above layers my prediction is 90% accurate. However, if I add LSTM layer after sequenceinputLayer, my accuracy suffers big time and I get a same predicted value no matter what sequence input do I use to predict. Can you suggest why is that?
Answers.UserDisplayName: NM08
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2018-05-23T16:51:04.123Z
Answers.Text: My Xtrain = 823x1 cell and each individual cell/sequence contains 9x1 double data. That is my features/predictors are 9 and there are total 823 observations. My Ytrain= 823x1 cell and It contains the response of each sequence.
Answers.UserDisplayName: NM08
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2018-05-24T05:45:09.077Z
Answers.Text: So, do you have 823 training points, where the input shape is (9,) and the output shape is (1,)? I am pretty sure about the (1,) because you do regression.
Answers.UserDisplayName: Molnár István
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2018-05-24T10:26:27.700Z
Answers.Text: Yes that is so.
Answers.UserDisplayName: NM08
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2018-05-23T16:00:49.070Z
Answers.LastActivityDate: 2018-05-23T16:07:35.713Z
Answers.LastEditDate: 2018-05-23T16:07:35.713Z
Answers.UserDisplayName: Molnár István
Body: <p>For a regression task, I have sequences of training data and if I define the layers of deep neural network to be:</p>
  
  <p>Layers=[ sequenceInputLayer(featuredimension) reluLayer dropoutLayer(0.05) fullyConnectedLayer(numResponse) regressionLayer]</p>
  
  <p>Is it a valid deep neural network? Or do I need to add LSTM layer too?</p>
  
Tags: <neural-networks><deep-learning><terminology><matlab>
Title: Is it a valid Deep Neural Network?
UserDisplayName: NM08
ThreadText: # Is it a valid Deep Neural Network?
  
  (Asked by: username_0 on 2018-05-23)
  
  For a regression task, I have sequences of training data and if I define the layers of deep neural network to be:
  
  Layers=[ sequenceInputLayer(featuredimension) reluLayer dropoutLayer(0.05) fullyConnectedLayer(numResponse) regressionLayer]
  
  Is it a valid deep neural network? Or do I need to add LSTM layer too?
  
  **Tags:** neural-networks, deep-learning, terminology, matlab
  
  
  ---
  
  ## 1 answers
  
  ### Answer by username_1 on 2018-05-23. Score: 1
  
  Yes, it is a very common practice to use some RNN when your input data is a sequence.
  Besides, your network has some shape issue if your input data is 2D. You should, at least flatten your input data to a vector to be able to forward propagate to the dense layer, but instead of this use some kind of RNN.
  To the best of my knowledge, that dropout value doesn't good. It seems too low.
  
  > **Comments:**
  > **username_0**: Thank you for helping. My training data is 1D and if I predict data using the above layers my prediction is 90% accurate. However, if I add LSTM layer after sequenceinputLayer, my accuracy suffers big time and I get a same predicted value no matter what sequence input do I use to predict. Can you suggest why is that?  
  > **username_0**: My Xtrain = 823x1 cell and each individual cell/sequence contains 9x1 double data. That is my features/predictors are 9 and there are total 823 observations. My Ytrain= 823x1 cell and It contains the response of each sequence.  
  > **username_1**: So, do you have 823 training points, where the input shape is (9,) and the output shape is (1,)? I am pretty sure about the (1,) because you do regression.  
  > **username_0**: Yes that is so.  
  
  ---
  
  