Configuration Parsing Warning: In config.json: "quantization_config.bits" must be an integer
Configuration Parsing Warning: In config.json: "quantization_config.bits" must be less than or equal to 8
Downloads last month
16
Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API was unable to determine this model's library.

Model tree for pipilok/phi-4-exl2-8.5bpw-hb8

Quantized
(7)
this model