a31413510 commited on
Commit
1f93d2a
·
verified ·
1 Parent(s): 1d5d5e4

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -83,8 +83,8 @@ python -m fastdeploy.entrypoints.openai.api_server \
83
  --port 8180 \
84
  --metrics-port 8181 \
85
  --engine-worker-queue-port 8182 \
86
- --max-model-len 32768 \ # Maximum supported number of tokens
87
- --max-num-seqs 32 # Maximum concurrent processing capacity
88
  ```
89
 
90
  ### Using `transformers` library
 
83
  --port 8180 \
84
  --metrics-port 8181 \
85
  --engine-worker-queue-port 8182 \
86
+ --max-model-len 32768 \
87
+ --max-num-seqs 32
88
  ```
89
 
90
  ### Using `transformers` library