ReadyArt
/

MN-2407-DSK-QwQify-v0.1-12B_EXL2_4.0bpw_H8

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions

MN-2407-DSK-QwQify-v0.1-12B_EXL2_4.0bpw_H8 / README.md

FrenzyBiscuit's picture

Update README.md

d06e4d0 verified 3 months ago

|

history blame contribute delete

178 Bytes

	---
	base_model:
	- BeaverAI/MN-2407-DSK-QwQify-v0.1-12B
	library_name: transformers
	base_model_relation: quantized

	---

	EXL2 Quants by FrenzyBiscuit.

	This model is 4.0 BPW EXL2.