robgreenberg3 commited on
Commit
9e8cd11
·
verified ·
1 Parent(s): f7882f0

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -75,7 +75,7 @@ The [llm-compressor](https://github.com/vllm-project/llm-compressor) library is
75
 
76
  1. Initialize vLLM server:
77
  ```
78
- vllm serve mistralai/Voxtral-Mini-3B-2507 --tokenizer_mode mistral --config_format mistral --load_format mistral
79
  ```
80
 
81
  2. Send requests to the server, according to the use case. See the following examples.
 
75
 
76
  1. Initialize vLLM server:
77
  ```
78
+ vllm serve RedHatAI/Voxtral-Mini-3B-2507-FP8-dynamic --tokenizer_mode mistral --config_format mistral --load_format mistral
79
  ```
80
 
81
  2. Send requests to the server, according to the use case. See the following examples.