Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

catid
/
cat-llama-3-8b-awq-q128-w4-gemm

Text Generation
Transformers
Safetensors
llama
conversational
text-generation-inference
4-bit precision
awq
Model card Files Files and versions Community
cat-llama-3-8b-awq-q128-w4-gemm
Ctrl+K
Ctrl+K
  • 1 contributor
History: 10 commits
catid's picture
catid
Update README.md
5c8f159 verified about 1 year ago
  • .gitattributes
    1.52 kB
    initial commit about 1 year ago
  • README.md
    1.13 kB
    Update README.md about 1 year ago
  • config.json
    894 Bytes
    add model about 1 year ago
  • generation_config.json
    152 Bytes
    fix generation_config.json about 1 year ago
  • model-00001-of-00002.safetensors
    4.68 GB
    LFS
    add model about 1 year ago
  • model-00002-of-00002.safetensors
    1.05 GB
    LFS
    add model about 1 year ago
  • model.safetensors.index.json
    63.5 kB
    add model about 1 year ago
  • special_tokens_map.json
    301 Bytes
    add model about 1 year ago
  • tokenizer.json
    9.08 MB
    add model about 1 year ago
  • tokenizer_config.json
    50.9 kB
    add model about 1 year ago