Hey @takieddine_soualhi I am trying to understand the use case.

In addition, the loss is calculated on all frames of a single video (the loss is equal to the mean of cross entropy across all frames).

Is it possible to treat each frame as a sample, so that the number of frames in the video will be the batch size? If that’s possible, then you can let each GPU to take care of a subset of the frames?