Update README.md
Browse files
README.md
CHANGED
|
@@ -122,3 +122,8 @@ outputs = llm.generate(prompt, sampling_params=sampling_params)
|
|
| 122 |
print(outputs[0].outputs[0].text)
|
| 123 |
# ' scene in Yosemite Valley and was taken at ISO 250 with an aperture of f/16 and a shutter speed of 1/18 second. ...'
|
| 124 |
```
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 122 |
print(outputs[0].outputs[0].text)
|
| 123 |
# ' scene in Yosemite Valley and was taken at ISO 250 with an aperture of f/16 and a shutter speed of 1/18 second. ...'
|
| 124 |
```
|
| 125 |
+
|
| 126 |
+
### Transformers (untested)
|
| 127 |
+
|
| 128 |
+
Transformers-compatible model weights are also uploaded (thanks a lot @cyrilvallez), but were **not throughly tested**, but only on "vibe-checks".
|
| 129 |
+
Hence, we can only ensure 100% correct behavior when using the original weight format with vllm (see above).
|