Update README.md
Browse files
README.md
CHANGED
@@ -83,8 +83,8 @@ python -m fastdeploy.entrypoints.openai.api_server \
|
|
83 |
--port 8180 \
|
84 |
--metrics-port 8181 \
|
85 |
--engine-worker-queue-port 8182 \
|
86 |
-
--max-model-len 32768 \
|
87 |
-
--max-num-seqs 32
|
88 |
```
|
89 |
|
90 |
### Using `transformers` library
|
|
|
83 |
--port 8180 \
|
84 |
--metrics-port 8181 \
|
85 |
--engine-worker-queue-port 8182 \
|
86 |
+
--max-model-len 32768 \
|
87 |
+
--max-num-seqs 32
|
88 |
```
|
89 |
|
90 |
### Using `transformers` library
|