Configuration Parsing Warning: In config.json: "quantization_config.bits" must be an integer

EXL2 Quants by FrenzyBiscuit.

This model is 4.35 BPW EXL2.

vision was not converted

NOTE: THIS IS A WEIRD QUANT FROM A MODEL THAT HAD VISION REMOVED. IF IT DOESN'T WORK, DON'T BLAME ME.

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for ReadyArt/Mistral-Small-3.1-24B-Instruct-2503-HF-NOVISION_EXL2_4.35bpw_H8

Base model

Quantized

(14)

this model

Collection including ReadyArt/Mistral-Small-3.1-24B-Instruct-2503-HF-NOVISION_EXL2_4.35bpw_H8