|
|
--- |
|
|
library_name: exllamav3 |
|
|
license: apache-2.0 |
|
|
license_link: https://huggingface.co/Qwen/Qwen3-235B-A22B/blob/main/LICENSE |
|
|
pipeline_tag: text-generation |
|
|
base_model: Qwen/Qwen3-235B-A22B |
|
|
base_model_relation: quantized |
|
|
tags: |
|
|
- exl3 |
|
|
--- |
|
|
|
|
|
Exllamav3 quantization of [Qwen/Qwen3-235B-A22B](https://huggingface.co/Qwen/Qwen3-235B-A22B) |
|
|
|
|
|
Quantized using commit 95cfa72 of the dev branch of [exllamav3](https://github.com/turboderp-org/exllamav3). |
|
|
|
|
|
[2.25 bpw h6](https://huggingface.co/MikeRoz/Qwen3-235B-A22B-exl3/tree/2.25bpw_H6) 63.375 GiB |
|
|
[3.00 bpw h6](https://huggingface.co/MikeRoz/Qwen3-235B-A22B-exl3/tree/3.00bpw_H6) 83.800 GiB |
|
|
[4.00 bpw h6](https://huggingface.co/MikeRoz/Qwen3-235B-A22B-exl3/tree/4.00bpw_H6) 111.018 GiB |
|
|
|
