EXL2 Quantizations of Qwen2-VL-7B-Instruct

Using exllamav2 release 0.2.6 for quantization.

Original model: https://huggingface.co/Qwen/Qwen2-VL-7B-Instruct

Bits 8.0, lm_head 8.0

Downloads last month: 16

Inference Providers NEW

This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API was unable to determine this model's library.

Model tree for Zenabius/Qwen2-VL-7B-Instruct-exl2

Base model

Qwen/Qwen2-VL-7B

Finetuned

Qwen/Qwen2-VL-7B-Instruct

Quantized

(40)

this model