Deep Learning, Artificial Intelligence, Visual Language, Foundation Models, Vlm.
Fine-Grained V+L Representation Learning CoSwin replaces the tokenization layer of CoSwin (in Section 2.3) from 2D convolutional layers to 3D convolutional layers, which converts each 3D tube into one token. 3D convolution-based patch merging operator is also used. 2D shifted window design is