Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up
fnlp 's Collections
MHA2MLA-refactor
Low Rank Sparse Attention
MHA2MLA

MHA2MLA-refactor

updated 7 days ago

The MHA2MLA model published in the paper "Towards Economical Inference: Enabling DeepSeek's Multi-Head Latent Attention in Any Transformer-Based LLMs"

Upvote
-

  • fnlp/SmolLM-135M-MLA-d_kv_8-refactor

    Text Generation • Updated about 21 hours ago • 2

  • fnlp/SmolLM-135M-MLA-d_kv_32-refactor

    Text Generation • Updated 7 days ago • 2

  • fnlp/SmolLM-135M-MLA-d_kv_16-refactor

    Text Generation • Updated 7 days ago • 2

  • fnlp/SmolLM-360M-MLA-d_kv_8-refactor

    Text Generation • Updated 7 days ago • 2

  • fnlp/SmolLM-360M-MLA-d_kv_16-refactor

    Text Generation • Updated 7 days ago • 2

  • fnlp/SmolLM-360M-MLA-d_kv_32-refactor

    Text Generation • Updated 7 days ago • 2

  • fnlp/smollm1-1B7-d_kv_8-refactor

    Text Generation • Updated 7 days ago • 2

  • fnlp/smollm1-1B7-d_kv_16-refactor

    Text Generation • Updated 7 days ago • 6

  • fnlp/smollm1-1B7-d_kv_32-refactor

    Text Generation • Updated 7 days ago • 8

  • fnlp/llama2-7B-d_kv_16-refactor

    Text Generation • Updated 7 days ago • 5

  • fnlp/llama2-7B-d_kv_32-refactor

    Text Generation • Updated 7 days ago • 5

  • fnlp/llama2-7B-d_kv_64-refactor

    Text Generation • Updated 7 days ago • 5
Upvote
-
  • Collection guide
  • Browse collections
Company
TOS Privacy About Jobs
Website
Models Datasets Spaces Pricing Docs