Update README.md
Browse files
README.md
CHANGED
@@ -315,6 +315,11 @@ Install vllm
|
|
315 |
VLLM_USE_PRECOMPILED=1 pip install --editable .
|
316 |
```
|
317 |
|
|
|
|
|
|
|
|
|
|
|
318 |
Run the benchmarks under `vllm` root folder:
|
319 |
|
320 |
## benchmark_latency
|
|
|
315 |
VLLM_USE_PRECOMPILED=1 pip install --editable .
|
316 |
```
|
317 |
|
318 |
+
To use fbgemm kernels:
|
319 |
+
```Shell
|
320 |
+
pip install fbgemm-gpu-genai
|
321 |
+
```
|
322 |
+
|
323 |
Run the benchmarks under `vllm` root folder:
|
324 |
|
325 |
## benchmark_latency
|