Qwen
/

Qwen3-30B-A3B-GGUF

Text Generation

Model card Files Files and versions

feihu.hf commited on May 11

Commit

dae61f0

·

1 Parent(s): f2226c5

update README

Files changed (1) hide show

README.md +1 -0

README.md CHANGED Viewed

@@ -47,6 +47,7 @@ Check out our [llama.cpp documentation](https://qwen.readthedocs.io/en/latest/ru
 We advise you to clone [`llama.cpp`](https://github.com/ggerganov/llama.cpp) and install it following the official guide. We follow the latest version of llama.cpp.
 In the following demonstration, we assume that you are running commands under the repository `llama.cpp`.
 ```shell
 ./llama-cli -hf Qwen/Qwen3-30B-A3B:Q8_0 --jinja --color -ngl 99 -fa -sm row --temp 0.6 --top-k 20 --top-p 0.95 --min-p 0 --presence-penalty 1.5 -c 40960 -n 32768 --no-context-shift
 ```

 We advise you to clone [`llama.cpp`](https://github.com/ggerganov/llama.cpp) and install it following the official guide. We follow the latest version of llama.cpp.
 In the following demonstration, we assume that you are running commands under the repository `llama.cpp`.
 ```shell
 ./llama-cli -hf Qwen/Qwen3-30B-A3B:Q8_0 --jinja --color -ngl 99 -fa -sm row --temp 0.6 --top-k 20 --top-p 0.95 --min-p 0 --presence-penalty 1.5 -c 40960 -n 32768 --no-context-shift
 ```