Fixed formatting
Browse files
README.md
CHANGED
|
@@ -28,6 +28,7 @@ Model checkpoint is saved in [compressed_tensors](https://github.com/neuralmagic
|
|
| 28 |
|
| 29 |
And example of inference via transformers is provided below:
|
| 30 |
|
|
|
|
| 31 |
# pip install accelerate
|
| 32 |
|
| 33 |
from transformers import AutoProcessor, AutoModelForImageTextToText
|
|
@@ -69,4 +70,5 @@ with torch.inference_mode():
|
|
| 69 |
generation = generation[0][input_len:]
|
| 70 |
|
| 71 |
decoded = processor.decode(generation, skip_special_tokens=True)
|
| 72 |
-
print(decoded)
|
|
|
|
|
|
| 28 |
|
| 29 |
And example of inference via transformers is provided below:
|
| 30 |
|
| 31 |
+
```
|
| 32 |
# pip install accelerate
|
| 33 |
|
| 34 |
from transformers import AutoProcessor, AutoModelForImageTextToText
|
|
|
|
| 70 |
generation = generation[0][input_len:]
|
| 71 |
|
| 72 |
decoded = processor.decode(generation, skip_special_tokens=True)
|
| 73 |
+
print(decoded)
|
| 74 |
+
```
|