jerryzh168 commited on
Commit
e45d601
·
verified ·
1 Parent(s): 926d6d3

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -50,7 +50,7 @@ print(output[0].outputs[0].text)
50
  ## Serving
51
  Then we can serve with the following command:
52
  ```
53
- vllm serve pytorch/Phi-4-mini-instruct-int4wo-hqq --tokenizer microsoft/Phi-4-mini-instruct -O3
54
  ```
55
 
56
  # Inference with Transformers
 
50
  ## Serving
51
  Then we can serve with the following command:
52
  ```
53
+ vllm serve pytorch/Phi-4-mini-instruct-float8dq --tokenizer microsoft/Phi-4-mini-instruct -O3
54
  ```
55
 
56
  # Inference with Transformers