Update README.md
Browse files
README.md
CHANGED
@@ -89,7 +89,7 @@ vllm serve scb10x/typhoon-ocr-7b --max-model-len 32000 --served-model-name typho
|
|
89 |
|
90 |
```python
|
91 |
from typhoon_ocr import ocr_document
|
92 |
-
markdown = ocr_document('image.png', base_url='http://localhost:8000/v1', api_key='
|
93 |
print(markdown)
|
94 |
```
|
95 |
To read more about [vllm](https://docs.vllm.ai/en/latest/getting_started/quickstart.html)
|
@@ -239,13 +239,15 @@ repetition_penalty: 1.2
|
|
239 |
|
240 |
We recommend to inference typhoon-ocr using [vllm](https://github.com/vllm-project/vllm) instead of huggingface transformers, and using typhoon-ocr library to ocr documents. To read more about [vllm](https://docs.vllm.ai/en/latest/getting_started/quickstart.html)
|
241 |
```bash
|
242 |
-
|
|
|
243 |
# then you can supply base_url in to ocr_document
|
244 |
```
|
245 |
|
246 |
```python
|
247 |
from typhoon_ocr import ocr_document
|
248 |
-
ocr_document('image.
|
|
|
249 |
```
|
250 |
|
251 |
## **Intended Uses & Limitations**
|
|
|
89 |
|
90 |
```python
|
91 |
from typhoon_ocr import ocr_document
|
92 |
+
markdown = ocr_document('image.png', base_url='http://localhost:8000/v1', api_key='no-key')
|
93 |
print(markdown)
|
94 |
```
|
95 |
To read more about [vllm](https://docs.vllm.ai/en/latest/getting_started/quickstart.html)
|
|
|
239 |
|
240 |
We recommend to inference typhoon-ocr using [vllm](https://github.com/vllm-project/vllm) instead of huggingface transformers, and using typhoon-ocr library to ocr documents. To read more about [vllm](https://docs.vllm.ai/en/latest/getting_started/quickstart.html)
|
241 |
```bash
|
242 |
+
pip install vllm
|
243 |
+
vllm serve scb10x/typhoon-ocr-7b --max-model-len 32000 --served-model-name typhoon-ocr-preview # OpenAI Compatible at http://localhost:8000
|
244 |
# then you can supply base_url in to ocr_document
|
245 |
```
|
246 |
|
247 |
```python
|
248 |
from typhoon_ocr import ocr_document
|
249 |
+
markdown = ocr_document('image.png', base_url='http://localhost:8000/v1', api_key='no-key')
|
250 |
+
print(markdown)
|
251 |
```
|
252 |
|
253 |
## **Intended Uses & Limitations**
|