Answers.Body: <p>You have not described exactly what the tasks will be, but there are some open source libraries for real time pose tracking. For example, <a href="https://github.com/CMU-Perceptual-Computing-Lab/openpose" rel="nofollow noreferrer">OpenPose</a> is one that can be configured to track the body, the hands and the face. However, this is only going to give you predicted pose information for each frame. If the subjects are meant to be doing specific tasks, e.g. picking up objects and moving them, OpenPose won't help and you may need to do further image recognition/analysis or object tracking in order to interpret what is going on.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2021-04-23T10:49:43.747Z
Answers.Text: Thanks for the reply. the problem has not been sufficiently defined yet but to get a high level idea, imagine  video showing close up of a trainee doctor performing stitches to close a wound. the AI model would be trained using many videos of someone performing the stitches correctly and score the trainee on a number of criteria.
  Ive updated the original post with this information.
Answers.UserDisplayName: wilson_smyth
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2021-04-23T05:45:42.840Z
Answers.LastActivityDate: 2021-04-23T05:45:42.840Z
Answers.UserDisplayName: Mike NZ
Body: <p>I have an AI/ML challenge in relation to video analysis and am unsure where to start.</p>
  <p>I am investigating an application that will grade students performance of carrying out a task, based on analysis of a video of them carrying out the task.</p>
  <p>The problem has not been sufficiently defined yet but to get a high level idea, imagine  video showing close up of a trainee doctor performing stitches to close a wound. the AI model would be trained using many videos of someone performing the stitches correctly and score the trainee on a number of criteria.</p>
  <p>Most frameworks will allow detection of objects but taking a video of a person carrying out a task and assessing their success using an AI/ML model feels a step above regular object analysis.</p>
  <p>Assumption is we will create the training material, having professionals video themselves carrying out the task successfully, which will also be graded by other professionals to provide a rubric of scores.</p>
  <p>I understand this is not something that can be simply answered but an idea of where to start would be very helpful.</p>
  <ul>
  <li>are there specific areas of AI i should investigate?</li>
  <li>are there frameworks that can actually do this ( i have not found any)?</li>
  </ul>
  <p>Appreciate any advice.</p>
  <p>Thank you</p>
  
Tags: <training><ai-design><video-classification>
Title: Video Analysis: Providing a success score for a of a student carrying out a specific task
UserDisplayName: wilson_smyth
ThreadText: # Video Analysis: Providing a success score for a of a student carrying out a specific task
  
  (Asked by: username_0 on 2021-04-22)
  
  I have an AI/ML challenge in relation to video analysis and am unsure where to start.
  
  I am investigating an application that will grade students performance of carrying out a task, based on analysis of a video of them carrying out the task.
  
  The problem has not been sufficiently defined yet but to get a high level idea, imagine video showing close up of a trainee doctor performing stitches to close a wound. the AI model would be trained using many videos of someone performing the stitches correctly and score the trainee on a number of criteria.
  
  Most frameworks will allow detection of objects but taking a video of a person carrying out a task and assessing their success using an AI/ML model feels a step above regular object analysis.
  
  Assumption is we will create the training material, having professionals video themselves carrying out the task successfully, which will also be graded by other professionals to provide a rubric of scores.
  
  I understand this is not something that can be simply answered but an idea of where to start would be very helpful.
  
  * are there specific areas of AI i should investigate?
  * are there frameworks that can actually do this ( i have not found any)?
  
  Appreciate any advice.
  
  Thank you
  
  **Tags:** training, ai-design, video-classification
  
  ---
  
  ## 1 answers
  
  ### Answer by username_1 on 2021-04-23. Score: 2
  
  You have not described exactly what the tasks will be, but there are some open source libraries for real time pose tracking. For example, [OpenPose](https://github.com/CMU-Perceptual-Computing-Lab/openpose) is one that can be configured to track the body, the hands and the face. However, this is only going to give you predicted pose information for each frame. If the subjects are meant to be doing specific tasks, e.g. picking up objects and moving them, OpenPose won't help and you may need to do further image recognition/analysis or object tracking in order to interpret what is going on.
  
  > **Comments:**
  > **username_0**: Thanks for the reply. the problem has not been sufficiently defined yet but to get a high level idea, imagine  video showing close up of a trainee doctor performing stitches to close a wound. the AI model would be trained using many videos of someone performing the stitches correctly and score the trainee on a number of criteria. Ive updated the original post with this information.  
  
  ---
  
  