It’s a task that has a label for each time_steps for a batch and I have to calculate the loss for that label. I previously asked about the case that the action recognition task is labeled per frame instead of per video, but I didn’t get any answers. If anyone knows a toy task related to the above, please let me know.

  
    
    
    How can I train action recognition for frame by frame of video using pytorch? vision
  
  
    I am referring to eriklindernoren/Action-Recognition now. The UCF101 dataset has “one action” for each video. Therefore, there is no problem with the following model output. 
        # output_layers of models.py
        self.output_layers = nn.Sequential(
            nn.Linear(2 * hidden_dim if bidirectional else hidden_dim, hidden_dim),
            nn.BatchNorm1d(hidden_dim, momentum=0.01),
            nn.ReLU(),
            nn.Linear(hidden_dim, num_classes),
            nn.Softmax(dim=-1),
  …