---
library_name: transformers
license: apache-2.0
base_model:
- allenai/Molmo-7B-D-0924
---

Molmo-7B-D BnB 4bit quant
30GB -> 7GB

approx. 12GB VRAM required

base model for more information:

https://huggingface.co/allenai/Molmo-7B-D-0924

example code:

https://github.com/cyan2k/molmo-7b-bnb-4bit

performance metrics & benchmarks to compare with base will follow over the next week