Answers.Body: <p>I think for LSTM, I have not come across a standard test, but when I started, I tried like this.</p>
  
  <p>Generate a sequence of numbers like, [0,1,2,3,4],[1,2,3,4,5]..... as the dataset and then your labels would be [5,6,.....].Train this using an LSTM network.This would be a good way to understand the parameters involved and by changing the number of layers, and different parameters you can easily check how it works.</p>
  
  <p>of course, mnist is the test for CNNs</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2019-10-14T05:38:24.300Z
Answers.Text: Yeh I did something similar (except using text, so I had a string of "the quick brown fox..." and used each character as a 1 hot vector) and I know it works fine, but the big problem is when testing your model against others (if you try to make an improvement somehow), it's good to use a standard so when trying to argue that x is better, you have something to compare that everyone is familiar with.
Answers.UserDisplayName: Recessive
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2019-10-14T05:32:32.847Z
Answers.LastActivityDate: 2019-10-14T05:32:32.847Z
Answers.UserDisplayName: SUMAN
Answers.Body: <p>It's more domain- or task-specific. There is no obvious baseline anymore because these models and this field has evolved into too large of an ecosystem. Nonetheless, I'll list a couple of notorious examples below.</p>
  
  <p><strong>Image classification:</strong>  </p>
  
  <ul>
  <li>MNIST</li>
  <li>CIFAR  </li>
  <li>ImageNet</li>
  </ul>
  
  <p><strong>Detection/segmentation:</strong>  </p>
  
  <ul>
  <li>PascalVOC  </li>
  <li>COCO  </li>
  <li>CityScapes  </li>
  </ul>
  
  <p><strong>Pose estimation:</strong>  </p>
  
  <ul>
  <li>MPII  </li>
  <li>LEEDS</li>
  </ul>
  
  <p><strong>Text classification:</strong>  </p>
  
  <ul>
  <li>IMDB  </li>
  <li>yelp  </li>
  </ul>
  
  <p><strong>Question answering:</strong>  </p>
  
  <ul>
  <li>SQuAD  </li>
  </ul>
  
  <p><strong>Translation:</strong>  </p>
  
  <ul>
  <li>WMT</li>
  <li>IWSLT  </li>
  </ul>
  
  <p>This is just a taste. There are tons more both in each category and the number of categories, a good source is the <a href="https://paperswithcode.com/sota" rel="nofollow noreferrer">Papers with Code</a> website.  </p>
  
  <p>Therefore, there is no single <em>standard</em> problem, given that there are too many that all in one shape or form use CNNs or RNNs (or others). </p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2019-10-15T16:12:22.513Z
Answers.LastActivityDate: 2019-10-20T15:07:47.947Z
Answers.LastEditDate: 2019-10-20T15:07:47.947Z
Answers.UserDisplayName: mshlis
Body: <p>What are the standard (or baseline) problems (or at least common ones) for CNNs and LSTMs? As an example, for a feed-forward neural net, a common problem is the XOR problem.</p>
  
  <p>Is there a standard problem like this for CNNs and LSTMs? I think for a CNN the standard test is to try it on MNIST, but I'm not sure of an LSTM.</p>
  
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2019-10-14T05:20:11.273Z
Comments.Text: for CNN its mnist
Comments.UserDisplayName: Eka
Tags: <convolutional-neural-networks><long-short-term-memory>
Title: What are the standard problems for CNNs and LSTMs?
UserDisplayName: Recessive
ThreadText: # What are the standard problems for CNNs and LSTMs?
  
  (Asked by: username_0 on 2019-10-14)
  
  What are the standard (or baseline) problems (or at least common ones) for CNNs and LSTMs? As an example, for a feed-forward neural net, a common problem is the XOR problem.
  
  Is there a standard problem like this for CNNs and LSTMs? I think for a CNN the standard test is to try it on MNIST, but I'm not sure of an LSTM.
  
  **Tags:** convolutional-neural-networks, long-short-term-memory
  
  > **Comments:**
  > **username_1**: for CNN its mnist  
  
  ---
  
  ## 2 answers
  
  ### Answer by username_3 on 2019-10-15. Score: 2 | Accepted answer
  
  It's more domain- or task-specific. There is no obvious baseline anymore because these models and this field has evolved into too large of an ecosystem. Nonetheless, I'll list a couple of notorious examples below.
  
  **Image classification:**
  
  * MNIST
  * CIFAR
  * ImageNet
  
  **Detection/segmentation:**
  
  * PascalVOC
  * COCO
  * CityScapes
  
  **Pose estimation:**
  
  * MPII
  * LEEDS
  
  **Text classification:**
  
  * IMDB
  * yelp
  
  **Question answering:**
  
  * SQuAD
  
  **Translation:**
  
  * WMT
  * IWSLT
  
  This is just a taste. There are tons more both in each category and the number of categories, a good source is the [Papers with Code](https://paperswithcode.com/sota) website.
  
  Therefore, there is no single *standard* problem, given that there are too many that all in one shape or form use CNNs or RNNs (or others).
  
  
  ---
  
  ### Answer by username_2 on 2019-10-14. Score: 1
  
  I think for LSTM, I have not come across a standard test, but when I started, I tried like this.
  
  Generate a sequence of numbers like, [0,1,2,3,4],[1,2,3,4,5]..... as the dataset and then your labels would be [5,6,.....].Train this using an LSTM network.This would be a good way to understand the parameters involved and by changing the number of layers, and different parameters you can easily check how it works.
  
  of course, mnist is the test for CNNs
  
  > **Comments:**
  > **username_0**: Yeh I did something similar (except using text, so I had a string of "the quick brown fox..." and used each character as a 1 hot vector) and I know it works fine, but the big problem is when testing your model against others (if you try to make an improvement somehow), it's good to use a standard so when trying to argue that x is better, you have something to compare that everyone is familiar with.  
  
  ---
  
  