unsloth
/

Mistral-Small-3.2-24B-Instruct-2506-GGUF

Image-Text-to-Text

Model card Files Files and versions

Mistral-Small-3.2-24B-Instruct-2506-GGUF

Ctrl+K

Ctrl+K

3 contributors

History: 83 commits

danielhanchen's picture

Upload folder using huggingface_hub

25ca48c verified 2 months ago

.gitattributes

3.94 kB

Upload folder using huggingface_hub 2 months ago
Mistral-Small-3.2-24B-Instruct-2506-BF16.gguf

47.2 GB
xet

Upload folder using huggingface_hub 2 months ago
Mistral-Small-3.2-24B-Instruct-2506-IQ4_NL.gguf

13.5 GB
xet

Upload folder using huggingface_hub 2 months ago
Mistral-Small-3.2-24B-Instruct-2506-IQ4_XS.gguf

12.8 GB
xet

Upload folder using huggingface_hub 2 months ago
Mistral-Small-3.2-24B-Instruct-2506-Q2_K.gguf

8.89 GB
xet

Upload folder using huggingface_hub 2 months ago
Mistral-Small-3.2-24B-Instruct-2506-Q2_K_L.gguf

9.05 GB
xet

Upload folder using huggingface_hub 2 months ago
Mistral-Small-3.2-24B-Instruct-2506-Q3_K_M.gguf

11.5 GB
xet

Upload folder using huggingface_hub 2 months ago
Mistral-Small-3.2-24B-Instruct-2506-Q3_K_S.gguf

10.4 GB
xet

Upload folder using huggingface_hub 2 months ago
Mistral-Small-3.2-24B-Instruct-2506-Q4_0.gguf

13.5 GB
xet

Upload folder using huggingface_hub 2 months ago
Mistral-Small-3.2-24B-Instruct-2506-Q4_1.gguf

14.9 GB
xet

Upload folder using huggingface_hub 2 months ago
Mistral-Small-3.2-24B-Instruct-2506-Q4_K_M.gguf

14.3 GB
xet

Upload folder using huggingface_hub 2 months ago
Mistral-Small-3.2-24B-Instruct-2506-Q4_K_S.gguf

13.5 GB
xet

Upload folder using huggingface_hub 2 months ago
Mistral-Small-3.2-24B-Instruct-2506-Q5_K_M.gguf

16.8 GB
xet

Upload folder using huggingface_hub 2 months ago
Mistral-Small-3.2-24B-Instruct-2506-Q5_K_S.gguf

16.3 GB
xet

Upload folder using huggingface_hub 2 months ago
Mistral-Small-3.2-24B-Instruct-2506-Q6_K.gguf

19.3 GB
xet

Upload folder using huggingface_hub 2 months ago
Mistral-Small-3.2-24B-Instruct-2506-Q8_0.gguf

25.1 GB
xet

Upload folder using huggingface_hub 2 months ago
Mistral-Small-3.2-24B-Instruct-2506-UD-IQ1_M.gguf

6.02 GB
xet

Upload folder using huggingface_hub 2 months ago
Mistral-Small-3.2-24B-Instruct-2506-UD-IQ1_S.gguf

5.56 GB
xet

Upload folder using huggingface_hub 2 months ago
Mistral-Small-3.2-24B-Instruct-2506-UD-IQ2_M.gguf

8.24 GB
xet

Upload folder using huggingface_hub 2 months ago
Mistral-Small-3.2-24B-Instruct-2506-UD-IQ2_XXS.gguf

6.75 GB
xet

Upload folder using huggingface_hub 2 months ago
Mistral-Small-3.2-24B-Instruct-2506-UD-IQ3_XXS.gguf

9.41 GB
xet

Upload folder using huggingface_hub 2 months ago
Mistral-Small-3.2-24B-Instruct-2506-UD-Q2_K_XL.gguf

9.29 GB
xet

Upload folder using huggingface_hub 2 months ago
Mistral-Small-3.2-24B-Instruct-2506-UD-Q3_K_XL.gguf

11.9 GB
xet

Upload folder using huggingface_hub 2 months ago
Mistral-Small-3.2-24B-Instruct-2506-UD-Q4_K_XL.gguf

14.5 GB
xet

Upload folder using huggingface_hub 2 months ago
Mistral-Small-3.2-24B-Instruct-2506-UD-Q5_K_XL.gguf

16.8 GB
xet

Upload folder using huggingface_hub 2 months ago
Mistral-Small-3.2-24B-Instruct-2506-UD-Q6_K_XL.gguf

20.8 GB
xet

Upload folder using huggingface_hub 2 months ago
Mistral-Small-3.2-24B-Instruct-2506-UD-Q8_K_XL.gguf

29 GB
xet

Upload folder using huggingface_hub 2 months ago
README.md

26.9 kB

Update README.md 2 months ago
imatrix_unsloth.dat

10 MB
xet

Upload folder using huggingface_hub 2 months ago
mmproj-BF16.gguf

878 MB
xet

Upload folder using huggingface_hub 2 months ago
mmproj-F16.gguf

878 MB
xet

Upload folder using huggingface_hub 2 months ago
mmproj-F32.gguf

1.76 GB
xet

Upload folder using huggingface_hub 2 months ago
params

131 Bytes

Create params 2 months ago
system

2.33 kB

Create system 2 months ago
template

699 Bytes

Create template 2 months ago