Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
Mungert
/
Mistral-Small-3.1-24B-Instruct-2503-GGUF
like
4
GGUF
24 languages
vllm
imatrix
License:
apache-2.0
Model card
Files
Files and versions
Community
Use this model
73754c5
Mistral-Small-3.1-24B-Instruct-2503-GGUF
1 contributor
History:
25 commits
Mungert
Upload Mistral-Small-3.1-24B-Instruct-2503-iq2_s.gguf with huggingface_hub
73754c5
verified
1 day ago
.gitattributes
3.46 kB
Upload Mistral-Small-3.1-24B-Instruct-2503-iq2_s.gguf with huggingface_hub
1 day ago
Mistral-Small-3.1-24B-Instruct-2503-bf16-q4_k.gguf
16.1 GB
LFS
Upload Mistral-Small-3.1-24B-Instruct-2503-bf16-q4_k.gguf with huggingface_hub
2 days ago
Mistral-Small-3.1-24B-Instruct-2503-bf16-q6_k.gguf
20.9 GB
LFS
Upload Mistral-Small-3.1-24B-Instruct-2503-bf16-q6_k.gguf with huggingface_hub
2 days ago
Mistral-Small-3.1-24B-Instruct-2503-bf16-q8_0.gguf
26.3 GB
LFS
Upload Mistral-Small-3.1-24B-Instruct-2503-bf16-q8_0.gguf with huggingface_hub
2 days ago
Mistral-Small-3.1-24B-Instruct-2503-bf16.gguf
47.2 GB
LFS
Upload Mistral-Small-3.1-24B-Instruct-2503-bf16.gguf with huggingface_hub
1 day ago
Mistral-Small-3.1-24B-Instruct-2503-f16-q4_k.gguf
16.1 GB
LFS
Upload Mistral-Small-3.1-24B-Instruct-2503-f16-q4_k.gguf with huggingface_hub
2 days ago
Mistral-Small-3.1-24B-Instruct-2503-f16-q6_k.gguf
20.9 GB
LFS
Upload Mistral-Small-3.1-24B-Instruct-2503-f16-q6_k.gguf with huggingface_hub
2 days ago
Mistral-Small-3.1-24B-Instruct-2503-f16-q8_0.gguf
26.3 GB
LFS
Upload Mistral-Small-3.1-24B-Instruct-2503-f16-q8_0.gguf with huggingface_hub
2 days ago
Mistral-Small-3.1-24B-Instruct-2503-f16.gguf
47.2 GB
LFS
Upload Mistral-Small-3.1-24B-Instruct-2503-f16.gguf with huggingface_hub
2 days ago
Mistral-Small-3.1-24B-Instruct-2503-iq1_s.gguf
5.27 GB
LFS
Upload Mistral-Small-3.1-24B-Instruct-2503-iq1_s.gguf with huggingface_hub
1 day ago
Mistral-Small-3.1-24B-Instruct-2503-iq2_s.gguf
7.48 GB
LFS
Upload Mistral-Small-3.1-24B-Instruct-2503-iq2_s.gguf with huggingface_hub
1 day ago
Mistral-Small-3.1-24B-Instruct-2503-iq3_m.gguf
10.7 GB
LFS
Upload Mistral-Small-3.1-24B-Instruct-2503-iq3_m.gguf with huggingface_hub
1 day ago
Mistral-Small-3.1-24B-Instruct-2503-iq3_s.gguf
10.4 GB
LFS
Upload Mistral-Small-3.1-24B-Instruct-2503-iq3_s.gguf with huggingface_hub
1 day ago
Mistral-Small-3.1-24B-Instruct-2503-iq4_xs.gguf
12.8 GB
LFS
Upload Mistral-Small-3.1-24B-Instruct-2503-iq4_xs.gguf with huggingface_hub
1 day ago
Mistral-Small-3.1-24B-Instruct-2503-q2_k_l.gguf
9.55 GB
LFS
Upload Mistral-Small-3.1-24B-Instruct-2503-q2_k_l.gguf with huggingface_hub
2 days ago
Mistral-Small-3.1-24B-Instruct-2503-q3_k_m.gguf
11.5 GB
LFS
Upload Mistral-Small-3.1-24B-Instruct-2503-q3_k_m.gguf with huggingface_hub
2 days ago
Mistral-Small-3.1-24B-Instruct-2503-q3_k_s.gguf
10.4 GB
LFS
Upload Mistral-Small-3.1-24B-Instruct-2503-q3_k_s.gguf with huggingface_hub
2 days ago
Mistral-Small-3.1-24B-Instruct-2503-q4_k_l.gguf
14.8 GB
LFS
Upload Mistral-Small-3.1-24B-Instruct-2503-q4_k_l.gguf with huggingface_hub
2 days ago
Mistral-Small-3.1-24B-Instruct-2503-q4_k_m.gguf
14.3 GB
LFS
Upload Mistral-Small-3.1-24B-Instruct-2503-q4_k_m.gguf with huggingface_hub
2 days ago
Mistral-Small-3.1-24B-Instruct-2503-q4_k_s.gguf
13.5 GB
LFS
Upload Mistral-Small-3.1-24B-Instruct-2503-q4_k_s.gguf with huggingface_hub
2 days ago
Mistral-Small-3.1-24B-Instruct-2503-q5_k_l.gguf
17.2 GB
LFS
Upload Mistral-Small-3.1-24B-Instruct-2503-q5_k_l.gguf with huggingface_hub
2 days ago
Mistral-Small-3.1-24B-Instruct-2503-q5_k_m.gguf
16.8 GB
LFS
Upload Mistral-Small-3.1-24B-Instruct-2503-q5_k_m.gguf with huggingface_hub
2 days ago
Mistral-Small-3.1-24B-Instruct-2503-q5_k_s.gguf
16.3 GB
LFS
Upload Mistral-Small-3.1-24B-Instruct-2503-q5_k_s.gguf with huggingface_hub
2 days ago
Mistral-Small-3.1-24B-Instruct-2503-q6_k_l.gguf
19.7 GB
LFS
Upload Mistral-Small-3.1-24B-Instruct-2503-q6_k_l.gguf with huggingface_hub
2 days ago
README.md
15.1 kB
Upload README.md with huggingface_hub
1 day ago
