---
license: other
license_name: mrl
inference: false
license_link: https://mistral.ai/licenses/MRL-0.1.md
base_model: mistralai/Mistral-Large-Instruct-2407
base_model_relation: quantized
---
[exllamav3](https://github.com/turboderp-org/exllamav3) quantizations of [Mistral-Large-Instruct-2407](https://huggingface.co/mistralai/Mistral-Large-Instruct-2407)

Will update this space with links to the quant branches as they finish uploading. Expect the same sizes as in [turboderp's exl3 quant of Mistral-Large-Instruct-2411](https://huggingface.co/turboderp/Mistral-Large-Instruct-2411-exl3).

[1.40 BPW/H4](https://huggingface.co/MikeRoz/Mistral-Large-Instruct-2407-exl3/tree/1.4bpw_H4)