Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up
relaxml 's Collections
YAQA
QuIP# Quantized Models
QTIP Quantized Models

YAQA

updated Jun 6

YAQA hessians (Sketch B) and models with the QTIP quantizer. See https://github.com/Cornell-RelaxML/yaqa/tree/main for more details.

Upvote
2

  • relaxml/Llama-3.1-70B-Instruct-2Bit-YAQA-QTIP

    11B • Updated May 22 • 1

  • relaxml/Llama-3.1-70B-Instruct-3Bit-YAQA-QTIP

    15B • Updated May 22

  • relaxml/Llama-3.1-70B-Instruct-4Bit-YAQA-QTIP

    19B • Updated May 22

  • relaxml/Llama-3.1-70B-Instruct-Hessians-2Sided

    Updated May 19

  • relaxml/Llama-3.1-8B-Instruct-Hessians-2Sided

    Updated May 19

  • relaxml/Gemma-3-12B-Instruct-Hessians-2Sided

    Updated May 19

  • relaxml/Llama-3.2-1B-Instruct-Hessians-2Sided

    Updated May 21

  • relaxml/Llama-3.2-3B-Instruct-Hessians-2Sided

    Updated May 21

  • relaxml/Llama-2-7B-Hessians-2Sided

    Updated Jun 6
Upvote
2
  • Collection guide
  • Browse collections
Company
TOS Privacy About Jobs
Website
Models Datasets Spaces Pricing Docs