This model was converted to OpenVINO IR with the following command:

optimum-cli export openvino -m "input" --task image-text-to-text --weight-format nf4 "output"

NOTE: Performed much better on CPU only (perhaps due to NF4 datatype)

Downloads last month
15
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for Echo9Zulu/The-Omega-Abomination-Gemma3-12B-v1.0-nf4-ov

Finetuned
(2)
this model

Collection including Echo9Zulu/The-Omega-Abomination-Gemma3-12B-v1.0-nf4-ov