4.92k
MTEB Leaderboard
🥇
Select benchmarks and languages for text embeddings evaluation
alkinun
AtAndDev
AI & ML interests
LLMs, Alignment, Merging, Unsloth, DPO, SFT, ORPO, SPIN..
Recent Activity
reacted
to
singhsidhukuldeep's
post
with 👀
1 day ago
I just came across a groundbreaking paper titled "Hypencoder: Hypernetworks for Information Retrieval" by researchers from the University of Massachusetts Amherst that introduces a fundamentally new paradigm for search technology.
Most current retrieval models rely on simple inner product calculations between query and document vectors, which severely limits their expressiveness. The authors prove theoretically that inner product similarity functions fundamentally constrain what types of relevance relationships can be captured.
Hypencoder takes a radically different approach: instead of encoding a query as a vector, it generates a small neural network (called a "q-net") that acts as a learned relevance function. This neural network takes document representations as input and produces relevance scores.
Under the hood, Hypencoder uses:
- Attention-based hypernetwork layers (hyperhead layers) that transform contextualized query embeddings into weights and biases for the q-net
- A document encoder that produces vector representations similar to existing models
- A graph-based greedy search algorithm for efficient retrieval that can search 8.8M documents in under 60ms
The results are impressive - Hypencoder significantly outperforms strong dense retrieval models on standard benchmarks like MS MARCO and TREC Deep Learning Track. The performance gap widens even further on complex retrieval tasks like tip-of-the-tongue queries and instruction-following retrieval.
What makes this approach particularly powerful is that neural networks are universal approximators, allowing Hypencoder to express far more complex relevance relationships than inner product similarity functions. The framework is also flexible enough to replicate any existing neural retrieval method while adding the ability to learn query-dependent weights.
liked
a Space
5 days ago
mteb/leaderboard
replied to
their
post
13 days ago
@nroggendorff is that you sama?
Organizations
AtAndDev's activity
liked
a
Space
5 days ago
liked
3
models
about 1 month ago
liked
2
datasets
about 1 month ago
liked
2
models
about 1 month ago
liked
3
datasets
about 1 month ago
liked
a
model
about 1 month ago
liked
2
models
about 2 months ago
liked
a
Space
about 2 months ago
liked
a
model
about 2 months ago
liked
a
Space
about 2 months ago
liked
2
models
about 2 months ago
liked
a
dataset
about 2 months ago