amd/Phi-3-mini-4k-instruct-awq-g128-int4-asym-fp16-onnx-hybrid
Text Generation
•
Updated
•
157
RyzenAI-1.3_LLM_Hybrid_Models
Models quantized by Quark and prepared for the OGA-based hybrid execution flow (Ryzen AI 1.3)
-
-
amd/Phi-3.5-mini-instruct-awq-g128-int4-asym-fp16-onnx-hybrid
Text Generation • Updated • 202 -
amd/Mistral-7B-Instruct-v0.3-awq-g128-int4-asym-fp16-onnx-hybrid
Updated • 282 -
amd/Qwen1.5-7B-Chat-awq-g128-int4-asym-fp16-onnx-hybrid
Text Generation • Updated • 280 -
amd/chatglm3-6b-awq-g128-int4-asym-fp16-onnx-hybrid
Updated • 21 -
amd/Llama-2-7b-hf-awq-g128-int4-asym-fp16-onnx-hybrid
Text Generation • Updated • 22 -
amd/Llama-2-7b-chat-hf-awq-g128-int4-asym-fp16-onnx-hybrid
Text Generation • Updated • 150 -
amd/Llama-3-8B-awq-g128-int4-asym-fp16-onnx-hybrid
Text Generation • Updated • 25 -
amd/Llama-3.1-8B-awq-g128-int4-asym-fp16-onnx-hybrid
Text Generation • Updated • 585 -
amd/Llama-3.2-1B-Instruct-awq-g128-int4-asym-fp16-onnx-hybrid
Updated • 2.35k -
amd/Llama-3.2-3B-Instruct-awq-g128-int4-asym-fp16-onnx-hybrid
Updated • 505