Update README.md
Browse files
README.md
CHANGED
|
@@ -35,7 +35,6 @@ Quick links:
|
|
| 35 |
- 📃 [Paper](https://molmo.allenai.org/paper.pdf)
|
| 36 |
- 🎥 [Blog with Videos](https://molmo.allenai.org/blog)
|
| 37 |
|
| 38 |
-
|
| 39 |
## Quick Start
|
| 40 |
|
| 41 |
To run Molmo, first install dependencies:
|
|
@@ -121,6 +120,9 @@ output = model.generate_from_batch(
|
|
| 121 |
|
| 122 |
Note that we have observed that this can change the output of the model compared to running with float32 weights.
|
| 123 |
|
|
|
|
|
|
|
|
|
|
| 124 |
## Evaluations
|
| 125 |
|
| 126 |
| Model | Average Score on 11 Academic Benchmarks | Human Preference Elo Rating |
|
|
|
|
| 35 |
- 📃 [Paper](https://molmo.allenai.org/paper.pdf)
|
| 36 |
- 🎥 [Blog with Videos](https://molmo.allenai.org/blog)
|
| 37 |
|
|
|
|
| 38 |
## Quick Start
|
| 39 |
|
| 40 |
To run Molmo, first install dependencies:
|
|
|
|
| 120 |
|
| 121 |
Note that we have observed that this can change the output of the model compared to running with float32 weights.
|
| 122 |
|
| 123 |
+
## vLLM
|
| 124 |
+
Molmo is supported in vLLM, however please use version <=0.7.2 until a [prepreprocessing bug](https://github.com/vllm-project/vllm/issues/26451) is fixed.
|
| 125 |
+
|
| 126 |
## Evaluations
|
| 127 |
|
| 128 |
| Model | Average Score on 11 Academic Benchmarks | Human Preference Elo Rating |
|