Llama-genie-qnn / README.md
Davidqian123's picture
Create README.md
540e716 verified

These two models are converted from meta-llama/Meta-Llama-3-8B and meta-llama/Llama-3.2-3B-Instruct using qai_hub_models

These models are compatible with Snapdragon® X Elite device and QNN v2.28.2.241116

Tech flow: Genie SDK + QNN + Qualcomm AI Hub

Follow README in https://github.com/quic/ai-hub-apps/blob/main/tutorials/llm_on_genie/README.md#run-llm-on-device