jerryzh168 commited on
Commit
700e10a
·
verified ·
1 Parent(s): a2a1dd6

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -0
README.md CHANGED
@@ -315,6 +315,11 @@ Install vllm
315
  VLLM_USE_PRECOMPILED=1 pip install --editable .
316
  ```
317
 
 
 
 
 
 
318
  Run the benchmarks under `vllm` root folder:
319
 
320
  ## benchmark_latency
 
315
  VLLM_USE_PRECOMPILED=1 pip install --editable .
316
  ```
317
 
318
+ To use fbgemm kernels:
319
+ ```Shell
320
+ pip install fbgemm-gpu-genai
321
+ ```
322
+
323
  Run the benchmarks under `vllm` root folder:
324
 
325
  ## benchmark_latency