Answers.Body: <p>Look at spatio-temporal CNNs which extend the image-based CNN in 2D to 3D to handle time.  These are commonly used to detect or classify action in a video.  People have used them to identify specific actions in various sports such as kicking a soccer ball, throwing a baseball or dribbling a basketball.  They have been used to identify fire, smoke, deep fakes, and violence in videos.  Below are some articles to help get started.</p>
  <ul>
  <li><a href="https://towardsdatascience.com/introduction-to-video-classification-6c6acbc57356" rel="nofollow noreferrer">Introduction to Video Classification, by Connor Shorten</a></li>
  <li><a href="https://towardsdatascience.com/are-you-ready-for-a-video-classification-challenge-d044e3b202b6" rel="nofollow noreferrer">Are you ready for a Video Classification Challenge? Preparation Guide for Video Classification, by Neha Goel</a></li>
  <li><a href="https://towardsdatascience.com/mict-net-for-human-action-recognition-in-videos-3a18e4f97342" rel="nofollow noreferrer">MiCT-Net for Human Action Recognition in Videos, by Florent Mahoudeau</a></li>
  </ul>
  <p>Source code:</p>
  <ul>
  <li><a href="https://github.com/HHTseng/video-classification" rel="nofollow noreferrer">Video Classification</a></li>
  <li><a href="https://github.com/kenshohara/video-classification-3d-cnn-pytorch" rel="nofollow noreferrer">Video Classification Using 3D ResNet</a></li>
  </ul>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2020-12-27T16:56:26.350Z
Answers.LastActivityDate: 2020-12-27T17:04:14.813Z
Answers.LastEditDate: 2020-12-27T17:04:14.813Z
Answers.UserDisplayName: Brian O'Donnell
Body: <p>I need to solve a video classification problem. While looking for solutions, I only found solutions that transform this problem into a series of simpler image classification tasks. However, this method has a downside: we ignore the temporal relationship between the frames.</p>
  <p>So, how can I perform video classification, with a CNN, by taking into account the temporal relationships between frames?</p>
  
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2020-12-29T11:13:18.490Z
Comments.Text: I edited this post to simplify and clarify it, and to make it more consistent with the answer that you accepted. Please, make sure that I did not change the meaning of it. If I did, you can just edit your post again and clarify what you're asking. If not, please, flag this comment for deletion.
Comments.UserDisplayName: nbro
Tags: <deep-learning><convolutional-neural-networks><reference-request><video-classification><action-recognition>
Title: How can I do video classification while taking into account the temporal dependencies of the frames?
UserDisplayName: אבנר יעקב
ThreadText: # How can I do video classification while taking into account the temporal dependencies of the frames?
  
  (Asked by: username_0 on 2020-12-22)
  
  I need to solve a video classification problem. While looking for solutions, I only found solutions that transform this problem into a series of simpler image classification tasks. However, this method has a downside: we ignore the temporal relationship between the frames.
  
  So, how can I perform video classification, with a CNN, by taking into account the temporal relationships between frames?
  
  **Tags:** deep-learning, convolutional-neural-networks, reference-request, video-classification, action-recognition
  > **Comments:**
  > **username_1**: I edited this post to simplify and clarify it, and to make it more consistent with the answer that you accepted. Please, make sure that I did not change the meaning of it. If I did, you can just edit your post again and clarify what you're asking. If not, please, flag this comment for deletion.  
  
  ---
  
  ## 1 answers
  
  ### Answer by username_2 on 2020-12-27. Score: 1 | Accepted answer
  
  Look at spatio-temporal CNNs which extend the image-based CNN in 2D to 3D to handle time. These are commonly used to detect or classify action in a video. People have used them to identify specific actions in various sports such as kicking a soccer ball, throwing a baseball or dribbling a basketball. They have been used to identify fire, smoke, deep fakes, and violence in videos. Below are some articles to help get started.
  
  * [Introduction to Video Classification, by Connor Shorten](https://towardsdatascience.com/introduction-to-video-classification-6c6acbc57356)
  * [Are you ready for a Video Classification Challenge? Preparation Guide for Video Classification, by Neha Goel](https://towardsdatascience.com/are-you-ready-for-a-video-classification-challenge-d044e3b202b6)
  * [MiCT-Net for Human Action Recognition in Videos, by Florent Mahoudeau](https://towardsdatascience.com/mict-net-for-human-action-recognition-in-videos-3a18e4f97342)
  
  Source code:
  
  * [Video Classification](https://github.com/HHTseng/video-classification)
  * [Video Classification Using 3D ResNet](https://github.com/kenshohara/video-classification-3d-cnn-pytorch)
  
  
  ---
  
  