Update README.md
Browse files
README.md
CHANGED
|
@@ -315,6 +315,11 @@ Install vllm
|
|
| 315 |
VLLM_USE_PRECOMPILED=1 pip install --editable .
|
| 316 |
```
|
| 317 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 318 |
Run the benchmarks under `vllm` root folder:
|
| 319 |
|
| 320 |
## benchmark_latency
|
|
|
|
| 315 |
VLLM_USE_PRECOMPILED=1 pip install --editable .
|
| 316 |
```
|
| 317 |
|
| 318 |
+
To use fbgemm kernels:
|
| 319 |
+
```Shell
|
| 320 |
+
pip install fbgemm-gpu-genai
|
| 321 |
+
```
|
| 322 |
+
|
| 323 |
Run the benchmarks under `vllm` root folder:
|
| 324 |
|
| 325 |
## benchmark_latency
|