Update README.md
Browse files
README.md
CHANGED
@@ -75,7 +75,7 @@ The [llm-compressor](https://github.com/vllm-project/llm-compressor) library is
|
|
75 |
|
76 |
1. Initialize vLLM server:
|
77 |
```
|
78 |
-
vllm serve
|
79 |
```
|
80 |
|
81 |
2. Send requests to the server, according to the use case. See the following examples.
|
|
|
75 |
|
76 |
1. Initialize vLLM server:
|
77 |
```
|
78 |
+
vllm serve RedHatAI/Voxtral-Mini-3B-2507-FP8-dynamic --tokenizer_mode mistral --config_format mistral --load_format mistral
|
79 |
```
|
80 |
|
81 |
2. Send requests to the server, according to the use case. See the following examples.
|