Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

TheBloke
/
KAI-7B-Instruct-AWQ

Text Generation
Transformers
Safetensors
mistral
finetuned
Instruct
code
conversational
text-generation-inference
4-bit precision
awq
Model card Files Files and versions Community
KAI-7B-Instruct-AWQ
Ctrl+K
Ctrl+K
  • 1 contributor
History: 8 commits
TheBloke's picture
TheBloke
Update for Transformers AWQ support
d2563d9 over 1 year ago
  • .gitattributes
    1.52 kB
    initial commit almost 2 years ago
  • README.md
    13.8 kB
    Upload README.md almost 2 years ago
  • config.json
    835 Bytes
    AWQ model commit almost 2 years ago
  • generation_config.json
    116 Bytes
    AWQ model commit almost 2 years ago
  • model.safetensors
    4.15 GB
    LFS
    AWQ model commit almost 2 years ago
  • quant_config.json
    90 Bytes
    AWQ model commit almost 2 years ago
  • special_tokens_map.json
    72 Bytes
    AWQ model commit almost 2 years ago
  • tokenizer.json
    1.8 MB
    AWQ model commit almost 2 years ago
  • tokenizer.model
    493 kB
    LFS
    AWQ model commit almost 2 years ago
  • tokenizer_config.json
    1.47 kB
    AWQ model commit almost 2 years ago