Answers.Body: <h2>Update:</h2>
  <p>I misread the question; It seems like OP is more interested in pose tracking. So, I'll have to point OP to papers on that, like <a href="https://arxiv.org/pdf/1804.06208v2.pdf" rel="nofollow noreferrer">this one</a>. Using multiple frames becomes especially important when there are multiple people in the frame, and it's desired to track which pose belongs to which person.</p>
  <p>For more papers on pose tracking, look <a href="https://paperswithcode.com/task/pose-tracking" rel="nofollow noreferrer">here</a>.</p>
  <hr />
  <p>Reading this immediately reminded me of <a href="https://modelzoo.co/model/openpose-caffe" rel="nofollow noreferrer">OpenPose</a>. The 2D poses are based on <a href="https://arxiv.org/pdf/1611.08050.pdf" rel="nofollow noreferrer">this paper</a>; They also refer to a few other papers and code repositories. There are several other 2D pose models at ModelZoo as well. They do refer to the papers they are based off of (or, at least, the ones I have seen do).</p>
  <p>Later work focuses on extracting even more 3D data from 2D images like <a href="https://arxiv.org/pdf/1802.00434v1.pdf" rel="nofollow noreferrer">this one</a> by Facebook. You can find much more on <a href="https://paperswithcode.com/task/2d-human-pose-estimation" rel="nofollow noreferrer">Papers with Code</a>.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2022-01-18T16:16:41.353Z
Answers.Text: I have already known OpenPose, but it does not seem use spatio-temporal data.
Answers.UserDisplayName: Bert Gayus
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2022-01-18T17:14:21.317Z
Answers.Text: @BertGayus I have updated the answer. Am I right in guessing that you are interested in human pose tracking?
Answers.UserDisplayName: Avatrin
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2022-01-14T19:03:46.557Z
Answers.LastActivityDate: 2022-01-18T17:13:58.070Z
Answers.LastEditDate: 2022-01-18T17:13:58.070Z
Answers.UserDisplayName: Avatrin
Answers.Body: <p>I don't think there is a great difference between pose estimation in pictures and in videos.
  Do you know MediaPipe? <a href="https://google.github.io/mediapipe/" rel="nofollow noreferrer">https://google.github.io/mediapipe/</a>
  MediaPipe does perform an tracking from the keypoints through time. So the temporal information is used. Apart from that it is the same problem as the estimation from keypoints in static images.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2022-01-18T16:14:39.743Z
Answers.Text: I think that the estimation of body position in images and videos should be different, because the spatio-temporal information in videos is an important aspect. For example, it is unlikely that my wrist at time t is not somewhere between its position in t-1 and t+1.
Answers.UserDisplayName: Bert Gayus
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2022-01-19T17:39:17.997Z
Answers.Text: This is the reason why tracking is used. Do you know Kalman-Filters? The output of the Neural Network is used as an measurement for the Kalman-Filter. Kalman-Filter perform a typ of error-correction. MediaPipe for example takes all frames into account.
Answers.UserDisplayName: highReynolds
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2022-01-13T09:27:36.463Z
Answers.LastActivityDate: 2022-01-13T09:27:36.463Z
Answers.UserDisplayName: highReynolds
Body: <p>Since pose estimation is often a task where spatial-temporal context should be helpful in finding subsequent key points, I thought there should be many papers on it. However, I could not find any work that deals with 2D pose estimation in videos.</p>
  <p>Am I missing something, or am I just hindered by a large number of papers on 3D position estimation?</p>
  
Tags: <convolutional-neural-networks><computer-vision><reference-request><transformer><pose-estimation>
Title: Are there any works that deal with 2D pose estimation in videos?
UserDisplayName: Bert Gayus
ThreadText: # Are there any works that deal with 2D pose estimation in videos?
  
  (Asked by: username_0 on 2022-01-11)
  
  Since pose estimation is often a task where spatial-temporal context should be helpful in finding subsequent key points, I thought there should be many papers on it. However, I could not find any work that deals with 2D pose estimation in videos.
  
  Am I missing something, or am I just hindered by a large number of papers on 3D position estimation?
  
  **Tags:** convolutional-neural-networks, computer-vision, reference-request, transformer, pose-estimation
  
  ---
  
  ## 2 answers
  
  ### Answer by username_1 on 2022-01-14. Score: 2
  
  ## Update:
  
  I misread the question; It seems like OP is more interested in pose tracking. So, I'll have to point OP to papers on that, like [this one](https://arxiv.org/pdf/1804.06208v2.pdf). Using multiple frames becomes especially important when there are multiple people in the frame, and it's desired to track which pose belongs to which person.
  
  For more papers on pose tracking, look [here](https://paperswithcode.com/task/pose-tracking).
  
  ---
  
  Reading this immediately reminded me of [OpenPose](https://modelzoo.co/model/openpose-caffe). The 2D poses are based on [this paper](https://arxiv.org/pdf/1611.08050.pdf); They also refer to a few other papers and code repositories. There are several other 2D pose models at ModelZoo as well. They do refer to the papers they are based off of (or, at least, the ones I have seen do).
  
  Later work focuses on extracting even more 3D data from 2D images like [this one](https://arxiv.org/pdf/1802.00434v1.pdf) by Facebook. You can find much more on [Papers with Code](https://paperswithcode.com/task/2d-human-pose-estimation).
  
  > **Comments:**
  > **username_0**: I have already known OpenPose, but it does not seem use spatio-temporal data.  
  > **username_1**: @BertGayus I have updated the answer. Am I right in guessing that you are interested in human pose tracking?  
  
  ---
  
  ### Answer by username_2 on 2022-01-13. Score: 1
  
  I don't think there is a great difference between pose estimation in pictures and in videos.
  Do you know MediaPipe? <https://google.github.io/mediapipe/>
  MediaPipe does perform an tracking from the keypoints through time. So the temporal information is used. Apart from that it is the same problem as the estimation from keypoints in static images.
  
  > **Comments:**
  > **username_0**: I think that the estimation of body position in images and videos should be different, because the spatio-temporal information in videos is an important aspect. For example, it is unlikely that my wrist at time t is not somewhere between its position in t-1 and t+1.  
  > **username_2**: This is the reason why tracking is used. Do you know Kalman-Filters? The output of the Neural Network is used as an measurement for the Kalman-Filter. Kalman-Filter perform a typ of error-correction. MediaPipe for example takes all frames into account.  
  
  ---
  
  