Quantized version of: unsloth/Devstral-Small-2505
Vision support is now available, thanks to work by ngxson.
They found that the original mmproj file from Mistral Small 3.1 is compatible with Devstral Small, enabling basic vision functionality. The compatible mmproj file is included here for those interested in trying it out.
Please note that this is not an official integration, and while it appears to work in practice, results may vary.
'Make knowledge free for everyone'
Made with
- Downloads last month
- 0
Hardware compatibility
Log In
to view the estimation
2-bit
3-bit
4-bit
5-bit
6-bit
8-bit
16-bit
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
Model tree for DevQuasar/unsloth.Devstral-Small-2505-GGUF
Base model
mistralai/Devstral-Small-2505