mlx-community/QVQ-72B-Preview-6bit

This model was converted to MLX format from Qwen/QVQ-72B-Preview using mlx-vlm version 0.1.6. Refer to the original model card for more details on the model.

Use with mlx

pip install -U mlx-vlm

python -m mlx_vlm.generate --model mlx-community/QVQ-72B-Preview-6bit --max-tokens 100 --temp 0.0

Downloads last month: 31

Safetensors

Model size

16.1B params

Tensor type

FP16

U32

Inference Providers NEW

Image-Text-to-Text

This model is not currently available via any of the supported third-party Inference Providers, and the HF Inference API does not support transformers models with pipeline type image-text-to-text

Model tree for mlx-community/QVQ-72B-Preview-6bit

Base model

Qwen/Qwen2-VL-72B

Finetuned

(12)

this model

Collection including mlx-community/QVQ-72B-Preview-6bit

QVQ-72B-Preview

Collection

5 items • Updated Dec 24, 2024 • 7