File size: 865 Bytes
c5747c6 037e2eb 6d617da 037e2eb c5747c6 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 |
---
license: llama3.2
tags:
- llama3.2
- llama3.2-3B
- rkllm
- rockchip
- rk3588
---
# Llama 3.2 3B for RK3588
This is a conversion from https://huggingface.co/meta-llama/Meta-Llama-3.2-3B to the RKLLM format for Rockchip devices.
Target conversion to be running on the RK3588 NPU.
**RKLLM runtime 1.1.1** requires **NPU driver 0.9.6**:
- [w8a8](https://huggingface.co/macrae/Llama-3-2-3B-rk3588/tree/w8a8-toolkitv1.1.1)
- [w8a8_g512](https://huggingface.co/macrae/Llama-3-2-3B-rk3588/tree/w8a8_g512-toolkitv1.1.1)
**RKLLM runtime 1.1.4** requires **NPU driver 0.9.8**:
- [w8a8](https://huggingface.co/macrae/Llama-3-2-3B-rk3588/tree/w8a8-toolkitv1.1.4)
- [w8a8_g512](https://huggingface.co/macrae/Llama-3-2-3B-rk3588//tree/w8a8_g512-toolkitv1.1.4)
# License
Same as the original LLM:
https://huggingface.co/meta-llama/Meta-Llama-3.2-3B/blob/main/LICENSE.txt |