EXL3 quantization of Qwen3-1.7B-Base, 8 bits per weight, including output layers.

Model	Q4	Q6	Q8	FP16
Qwen3-1.7B-exl3-8bpw-h8	0.0%	70.7%	68.3%	68.9%
Qwen3-1.7B-Base-exl3-8bpw-h8	0.0%	66.5%	70.7%	70.1%

Safetensors

Model size

1.17B params

Tensor type

FP16

I16

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for isogen/Qwen3-1.7B-Base-exl3-8bpw-h8

Base model

Quantized

(11)

this model