Hugging Face's logo

RedHatAI
/
Phi-3-medium-128k-instruct-quantized.w8a8

Text Generation
Transformers
Safetensors
English
phi3
conversational
custom_code
text-generation-inference
8-bit precision
compressed-tensors
Model card Files Community
Phi-3-medium-128k-instruct-quantized.w8a8
  • 2 contributors
 History: 10 commits
mgoin's picture
mgoin
Updated compression_config to quantization_config
4b7e106 verified