RKLLM Runtime 1.1.1
Collection
Model collections converted with RKLLM Runtime 1.1.1, requieres NPU Driver version 0.9.6
•
3 items
•
Updated
Llama 3.2 3B for RK3588
This is a conversion from https://huggingface.co/meta-llama/Meta-Llama-3.2-3B to the RKLLM format for Rockchip devices. Target conversion to be running on the RK3588 NPU.
RKLLM runtime 1.1.1 requires NPU driver 0.9.6:
RKLLM runtime 1.1.4 requires NPU driver 0.9.8:
License
Same as the original LLM:
https://huggingface.co/meta-llama/Meta-Llama-3.2-3B/blob/main/LICENSE.txt
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support