---
license: apache-2.0
thumbnail: https://cdn-uploads.huggingface.co/production/uploads/6625f4a8a8d1362ebcc3851a/hIZ2ZcaDyfYLT9Yd4pfOs.jpeg
language:
- en
pipeline_tag: text-generation
base_model:
- ArliAI/QwQ-32B-ArliAI-RpR-v4
base_model_relation: quantized
tags:
- exl3
library_name: exllamav3
---
exllamav3 quantizations of ArliAI's [QwQ-32B-ArliAI-RpR-v4](https://huggingface.co/ArliAI/QwQ-32B-ArliAI-RpR-v4).

[2.25bpw h6](https://huggingface.co/MikeRoz/QwQ-32B-ArliAI-RpR-v4-exl3/tree/2.25bpw_H6) (10.201 GiB)    
[3.00bpw h6](https://huggingface.co/MikeRoz/QwQ-32B-ArliAI-RpR-v4-exl3/tree/3.00bpw_H6) (12.925 GiB)    
[4.00bpw h6](https://huggingface.co/MikeRoz/QwQ-32B-ArliAI-RpR-v4-exl3/tree/4.00bpw_H6) (16.558 GiB)    
[6.00bpw h6](https://huggingface.co/MikeRoz/QwQ-32B-ArliAI-RpR-v4-exl3/tree/6.00bpw_H6) (23.824 GiB)    
[8.00bpw h8](https://huggingface.co/MikeRoz/QwQ-32B-ArliAI-RpR-v4-exl3/tree/8.00bpw_H8) (31.271 GiB)