ModernBert for multi-vector embeddings

#11
by admarcosai - opened

I do not know if this idea holds any weight or I just don't understand how multi-vector embedding models work but could token embeddings extracted from the layer just before pooling be effectively used for late interaction and be expected to perform at least as well as colbertv2?

Sign up or log in to comment