Exllamav2 quantization of Qwen/Qwen3-235B-A22B

Quantized using commit 68976a0 of the dev branch of exllamav2. Support for this architecture does not appear to be in the main branch as of this writing. To use this model, please either build the dev branch from source, or wait for a future release.

3.00 bpw h6 83.410 GiB
4.00 bpw h6 110.628 GiB
measurement.json

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference Providers NEW

Text Generation

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for MikeRoz/Qwen3-235B-A22B-exl2

Base model

Qwen/Qwen3-235B-A22B

Quantized

(21)

this model