thanhtantran

/

Llama-3.1-8B-Instruct-rk3588-1.2.0

like 0

Hi! Great work converting models to RKLLM. I understand that since 1.2.0 version of the library the max context size of the models can be up to 16k, but that size must be specify during conversion, if not specify it use the default 4096. Do you specify the max context size during conversion for models with 1.2.X library?