amd/Phi-3-mini-4k-instruct-awq-g128-int4-asym-fp16-onnx-hybrid
Text Generation
•
Updated
•
4
quark_awq_g128_int4_asym_fp16_onnx_hybrid 1.3
Models quantized by Quark and prepared for the OGA-based hybrid execution flow (Ryzen AI 1.3)
-
-
amd/Phi-3.5-mini-instruct-awq-g128-int4-asym-fp16-onnx-hybrid
Text Generation • Updated • 5 -
amd/Mistral-7B-Instruct-v0.3-awq-g128-int4-asym-fp16-onnx-hybrid
Updated • 11 -
amd/Qwen1.5-7B-Chat-awq-g128-int4-asym-fp16-onnx-hybrid
Text Generation • Updated • 10 -
amd/chatglm3-6b-awq-g128-int4-asym-fp16-onnx-hybrid
Updated • 9 -
amd/Llama-2-7b-hf-awq-g128-int4-asym-fp16-onnx-hybrid
Text Generation • Updated • 7 -
amd/Llama-2-7b-chat-hf-awq-g128-int4-asym-fp16-onnx-hybrid
Text Generation • Updated • 13 -
amd/Llama-3-8B-awq-g128-int4-asym-fp16-onnx-hybrid
Text Generation • Updated • 8 -
amd/Llama-3.1-8B-awq-g128-int4-asym-fp16-onnx-hybrid
Text Generation • Updated • 8 -
amd/Llama-3.2-1B-Instruct-awq-g128-int4-asym-fp16-onnx-hybrid
Updated • 37 -
amd/Llama-3.2-3B-Instruct-awq-g128-int4-asym-fp16-onnx-hybrid
Updated • 15