Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
Mungert
/
Mistral-Small-3.2-24B-Instruct-2506-GGUF
like
0
Image-Text-to-Text
GGUF
24 languages
vllm
conversational
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
Use this model
8027945
Mistral-Small-3.2-24B-Instruct-2506-GGUF
Ctrl+K
Ctrl+K
1 contributor
History:
17 commits
Mungert
Upload Mistral-Small-3.2-24B-Instruct-2506-q3_k_s.gguf with huggingface_hub
8027945
verified
2 months ago
.gitattributes
2.88 kB
Upload Mistral-Small-3.2-24B-Instruct-2506-q3_k_s.gguf with huggingface_hub
2 months ago
Mistral-Small-3.2-24B-Instruct-2506-bf16_q4_k.gguf
Safe
26.4 GB
xet
Upload Mistral-Small-3.2-24B-Instruct-2506-bf16_q4_k.gguf with huggingface_hub
2 months ago
Mistral-Small-3.2-24B-Instruct-2506-bf16_q6_k.gguf
Safe
30.1 GB
xet
Upload Mistral-Small-3.2-24B-Instruct-2506-bf16_q6_k.gguf with huggingface_hub
2 months ago
Mistral-Small-3.2-24B-Instruct-2506-bf16_q8_0.gguf
Safe
33.6 GB
xet
Upload Mistral-Small-3.2-24B-Instruct-2506-bf16_q8_0.gguf with huggingface_hub
2 months ago
Mistral-Small-3.2-24B-Instruct-2506-f16.gguf
Safe
47.2 GB
xet
Upload Mistral-Small-3.2-24B-Instruct-2506-f16.gguf with huggingface_hub
2 months ago
Mistral-Small-3.2-24B-Instruct-2506-f16_q4_k.gguf
Safe
26.4 GB
xet
Upload Mistral-Small-3.2-24B-Instruct-2506-f16_q4_k.gguf with huggingface_hub
2 months ago
Mistral-Small-3.2-24B-Instruct-2506-f16_q6_k.gguf
Safe
30.1 GB
xet
Upload Mistral-Small-3.2-24B-Instruct-2506-f16_q6_k.gguf with huggingface_hub
2 months ago
Mistral-Small-3.2-24B-Instruct-2506-f16_q8_0.gguf
Safe
33.6 GB
xet
Upload Mistral-Small-3.2-24B-Instruct-2506-f16_q8_0.gguf with huggingface_hub
2 months ago
Mistral-Small-3.2-24B-Instruct-2506-q2_k_l.gguf
Safe
9.47 GB
xet
Upload Mistral-Small-3.2-24B-Instruct-2506-q2_k_l.gguf with huggingface_hub
2 months ago
Mistral-Small-3.2-24B-Instruct-2506-q2_k_m.gguf
Safe
9.14 GB
xet
Upload Mistral-Small-3.2-24B-Instruct-2506-q2_k_m.gguf with huggingface_hub
2 months ago
Mistral-Small-3.2-24B-Instruct-2506-q2_k_s.gguf
Safe
8.39 GB
xet
Upload Mistral-Small-3.2-24B-Instruct-2506-q2_k_s.gguf with huggingface_hub
2 months ago
Mistral-Small-3.2-24B-Instruct-2506-q3_k_l.gguf
Safe
12 GB
xet
Upload Mistral-Small-3.2-24B-Instruct-2506-q3_k_l.gguf with huggingface_hub
2 months ago
Mistral-Small-3.2-24B-Instruct-2506-q3_k_m.gguf
Safe
11.6 GB
xet
Upload Mistral-Small-3.2-24B-Instruct-2506-q3_k_m.gguf with huggingface_hub
2 months ago
Mistral-Small-3.2-24B-Instruct-2506-q3_k_s.gguf
Safe
10.6 GB
xet
Upload Mistral-Small-3.2-24B-Instruct-2506-q3_k_s.gguf with huggingface_hub
2 months ago
Mistral-Small-3.2-24B-Instruct-2506-q4_k_l.gguf
Safe
14.7 GB
xet
Upload Mistral-Small-3.2-24B-Instruct-2506-q4_k_l.gguf with huggingface_hub
2 months ago
Mistral-Small-3.2-24B-Instruct-2506-q5_k_l.gguf
Safe
17.2 GB
xet
Upload Mistral-Small-3.2-24B-Instruct-2506-q5_k_l.gguf with huggingface_hub
2 months ago
Mistral-Small-3.2-24B-Instruct-2506-q6_k_l.gguf
Safe
19.7 GB
xet
Upload Mistral-Small-3.2-24B-Instruct-2506-q6_k_l.gguf with huggingface_hub
2 months ago
