Update README.md
Browse files
README.md
CHANGED
|
@@ -99,13 +99,7 @@ transformers==4.52.3
|
|
| 99 |
border: 1px solid rgba(255, 165, 0, 0.3);
|
| 100 |
margin: 16px 0;
|
| 101 |
">
|
| 102 |
-
### 【💡Notes on New VLLM Versions💡】
|
| 103 |
|
| 104 |
-
#### 1. Recommend Using V0 Inference Mode
|
| 105 |
-
Before launching vLLM, set the environment variable
|
| 106 |
-
```
|
| 107 |
-
export VLLM_USE_V1=0
|
| 108 |
-
```
|
| 109 |
</div>
|
| 110 |
|
| 111 |
<div style="
|
|
|
|
| 99 |
border: 1px solid rgba(255, 165, 0, 0.3);
|
| 100 |
margin: 16px 0;
|
| 101 |
">
|
|
|
|
| 102 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 103 |
</div>
|
| 104 |
|
| 105 |
<div style="
|