Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

geninhu
/
RakutenAI-7B-instruct-GPTQ

English
Japanese
mistral
gptq
4bit
vllm
quantized
4-bit precision
Model card Files Files and versions Community
RakutenAI-7B-instruct-GPTQ
Ctrl+K
Ctrl+K
  • 1 contributor
History: 2 commits
geninhu's picture
geninhu
Upload of AutoGPTQ quantized model
1fd946a verified 4 days ago
  • .gitattributes
    1.52 kB
    initial commit 4 days ago
  • README.md
    852 Bytes
    Upload of AutoGPTQ quantized model 4 days ago
  • config.json
    964 Bytes
    Upload of AutoGPTQ quantized model 4 days ago
  • gptq_model-4bit-128g.safetensors
    4.42 GB
    LFS
    Upload of AutoGPTQ quantized model 4 days ago
  • quantize_config.json
    265 Bytes
    Upload of AutoGPTQ quantized model 4 days ago
  • special_tokens_map.json
    620 Bytes
    Upload of AutoGPTQ quantized model 4 days ago
  • tokenizer.json
    4.94 MB
    Upload of AutoGPTQ quantized model 4 days ago
  • tokenizer.model
    755 kB
    LFS
    Upload of AutoGPTQ quantized model 4 days ago
  • tokenizer_config.json
    1.06 kB
    Upload of AutoGPTQ quantized model 4 days ago