metadata
library_name: exllamav3
license: apache-2.0
license_link: https://huggingface.co/Qwen/Qwen3-235B-A22B/blob/main/LICENSE
pipeline_tag: text-generation
base_model: Qwen/Qwen3-235B-A22B
base_model_relation: quantized
tags:
- exl3
Exllamav3 quantization of Qwen/Qwen3-235B-A22B
Quantized using commit 95cfa72 of the dev branch of exllamav3.
2.25 bpw h6 63.375 GiB
3.00 bpw h6 83.800 GiB
4.00 bpw h6 111.018 GiB