deepseek-ai
/

DeepSeek-V3.1-Terminus

Text Generation

text-generation-inference

Model card Files Files and versions

GeeeekExplorer commited on 24 days ago

Commit

19510d6

·

verified ·

1 Parent(s): 74b7f11

Update inference/README.md

Files changed (1) hide show

inference/README.md +1 -1

inference/README.md CHANGED Viewed

@@ -9,5 +9,5 @@ python convert.py --hf-ckpt-path ${HF_CKPT_PATH} --save-path ${SAVE_PATH} --n-ex
 Then chat with DeepSeek model at will!
 ```bash
 export CONFIG=config_671B_v3.1.json
-torchrun --nproc-per-node ${MP} generate.py --ckpt-path ${SAVE_PATH} --config ${CONFIG} --interactive --temperature {T}
 ```

 Then chat with DeepSeek model at will!
 ```bash
 export CONFIG=config_671B_v3.1.json
+torchrun --nproc-per-node ${MP} generate.py --ckpt-path ${SAVE_PATH} --config ${CONFIG} --interactive
 ```