Deep Learning, Sora, Computer Vision, Transformers, Attention.
different approch here and use segment-anything point prompt encoding here. for each image, we get centers of all the patches and scale them using max(w, h) then pass it through a linear layer then we use sin cos on each embedding vector and concat them w, h = timg[0].shape[2:] x = torch.arange(0,