RKLLM Runtime 1.1.1
Collection
Model collections converted with RKLLM Runtime 1.1.1, requieres NPU Driver version 0.9.6
•
3 items
•
Updated
Llama 3 Instruct 8B for RK3588
This is a conversion from https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct to the RKLLM format for Rockchip devices. Target conversion to be running on the RK3588 NPU.
Converted with RKLLM runtime 1.1.1
License
Same as the original LLM:
https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct/blob/main/LICENSE.txt
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support