Configuration Parsing Warning: In config.json: "quantization_config.bits" must be an integer

EXL2 Quants by FrenzyBiscuit.

This model is 5.5 BPW EXL2.

Downloads last month
26
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for ReadyArt/Skyfall-36B-v2_EXL2_5.5bpw_H8

Quantized
(32)
this model