RKLLM Runtime 1.0.1
Collection
Model collections converted with RKLLM Runtime 1.1.1, requieres NPU Driver version 0.9.6
Model collections converted with RKLLM Runtime 1.0.1
•
2 items
•
Updated
Llama 2 Chat 7B for RK3588
This is a conversion from https://huggingface.co/meta-llama/Llama-2-7b-chat-hf to the RKLLM format for Rockchip devices. This runs on the NPU from the RK3588.
Converted with RKLLM runtime 1.0.1 using docker template from https://huggingface.co/Pelochus
License
Same as the original LLM:
https://huggingface.co/meta-llama/Llama-2-7b-chat-hf/blob/main/LICENSE.txt
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support