Deep Learning, Sora, Computer Vision, Transformers, Attention.
using a for loop for each image. less than 2% of the batches have varied images of different shapes as we have already sorted them based on aspect ratio. so we can batch them if they are all the same shape. Fractional positional emebedding is the key part and we used a simple network to generate