YAML Metadata
Warning:
empty or missing yaml metadata in repo card
(https://huggingface.co/docs/hub/model-cards#model-card-metadata)
microsoft/Phi-4-mini-instruct converted to OpenVINO with symmetric INT4 weight compression.
Quick start:
pip install huggingface-hub[cli] openvino-genai==2025.2
curl -O https://raw.githubusercontent.com/helena-intel/snippets/refs/heads/main/llm_chat/python/llm_chat_manual.py
huggingface-cli download helenai/Phi-4-mini-instruct-ov-sym --local-dir Phi-4-mini-instruct-ov-sym
python llm_chat_manual.py Phi-4-mini-instruct-ov-sym CPU
In the last line, change CPU to GPU or NPU to run on Intel GPU or NPU. For NPU inference, make sure that the latest version of the NPU driver is installed (Windows, Linux)
Model export command:
pip install optimum-intel[openvino]@git+https://github.com/huggingface/optimum-intel.git
optimum-cli export openvino -m microsoft/Phi-4-mini-instruct --weight-format int4 --group-size -1 --sym phi-4-mini-instruct-ov-sym
- Downloads last month
- 8
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support