ReadyArt
/

QwQ-32B-Snowdrop-v0_EXL2_8.0bpw_H8

Text Generation

text-generation-inference

8-bit precision

Model card Files Files and versions Community

EXL2 Quants by FrenzyBiscuit.

This model is 8.0 BPW EXL2.

Downloads last month: 26

Inference Providers NEW

Text Generation

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for ReadyArt/QwQ-32B-Snowdrop-v0_EXL2_8.0bpw_H8

Base model

trashpanda-org/QwQ-32B-Snowdrop-v0

Quantized

(12)

this model

Collection including ReadyArt/QwQ-32B-Snowdrop-v0_EXL2_8.0bpw_H8

QwQ Snowdrop - 32B - EXL2

EXL2 quants by FrenzyBiscuit • 4 items • Updated 30 days ago