Hugging Face's logo

macrae
/
Llama-3-2-1B-rk3588

RKLLM
llama3.2
llama3.2-1B
rockchip
rk3588
Model card Files
xet
Community
macrae commited on
Commit
26b8e03
·
verified ·
1 Parent(s): b1114cc

Update README.md

Browse files

NPU requirement notes added

Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -12,11 +12,11 @@ tags:
12
  This is a conversion from https://huggingface.co/meta-llama/Meta-Llama-3.2-1B to the RKLLM format for Rockchip devices.
13
  Target conversion to be running on the RK3588 NPU.
14
 
15
- **RKLLM runtime 1.1.1** :
16
  - [w8a8](https://huggingface.co/macrae/Llama-3-2-1B-rk3588/tree/w8a8-toolkitv1.1.1)
17
  - [w8a8_g512](https://huggingface.co/macrae/Llama-3-2-1B-rk3588//tree/w8a8_g512-toolkitv1.1.1)
18
 
19
- **RKLLM runtime 1.1.4** :
20
  - [w8a8](https://huggingface.co/macrae/Llama-3-2-1B-rk3588/tree/w8a8-toolkitv1.1.4)
21
  - [w8a8_g512](https://huggingface.co/macrae/Llama-3-2-1B-rk3588//tree/w8a8_g512-toolkitv1.1.4)
22
 
 
12
  This is a conversion from https://huggingface.co/meta-llama/Meta-Llama-3.2-1B to the RKLLM format for Rockchip devices.
13
  Target conversion to be running on the RK3588 NPU.
14
 
15
+ **RKLLM runtime 1.1.1** requires **NPU driver 0.9.6**:
16
  - [w8a8](https://huggingface.co/macrae/Llama-3-2-1B-rk3588/tree/w8a8-toolkitv1.1.1)
17
  - [w8a8_g512](https://huggingface.co/macrae/Llama-3-2-1B-rk3588//tree/w8a8_g512-toolkitv1.1.1)
18
 
19
+ **RKLLM runtime 1.1.4** requires **NPU driver 0.9.8**:
20
  - [w8a8](https://huggingface.co/macrae/Llama-3-2-1B-rk3588/tree/w8a8-toolkitv1.1.4)
21
  - [w8a8_g512](https://huggingface.co/macrae/Llama-3-2-1B-rk3588//tree/w8a8_g512-toolkitv1.1.4)
22