EXL2 Quants by FrenzyBiscuit.

This model is 8.0 BPW EXL2.

vision was not converted

NOTE: THIS IS A WEIRD QUANT FROM A MODEL THAT HAD VISION REMOVED. IF IT DOESN'T WORK, DON'T BLAME ME.

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for ReadyArt/Mistral-Small-3.1-24B-Instruct-2503-HF-NOVISION_EXL2_8.0bpw_H8

Base model

Quantized

(14)

this model

Collection including ReadyArt/Mistral-Small-3.1-24B-Instruct-2503-HF-NOVISION_EXL2_8.0bpw_H8