AXERA-TECH
/

Qwen2.5-0.5B-Instruct-CTX-Int8

Qwen2.5-0.5B-Instruct

Qwen2.5-0.5B-Instruct-GPTQ-Int8

Model card Files Files and versions Community

qqc1989 commited on 1 day ago

Commit

c3c2106

·

verified ·

1 Parent(s): d39b40f

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -71,7 +71,7 @@ Server running at http://0.0.0.0:12345
 #### Inference with AX650 Host, such as M4N-Dock(爱芯派Pro) or AX650N DEMO Board
-Open another terminal and run `run_qwen2.5_0.5b_gptq_int4_ax650.sh`
 ```
 root@ax650:/mnt/qtang/llm-test/qwen2.5-0.5b-ctx# ./run_qwen2.5_0.5b_gptq_int8_ctx_ax650.sh

 #### Inference with AX650 Host, such as M4N-Dock(爱芯派Pro) or AX650N DEMO Board
+Open another terminal and run `run_qwen2.5_0.5b_gptq_int8_ax650.sh`
 ```
 root@ax650:/mnt/qtang/llm-test/qwen2.5-0.5b-ctx# ./run_qwen2.5_0.5b_gptq_int8_ctx_ax650.sh