Hugging Face's logo

gabriellarson
/
Mistral-Small-3.2-24B-Instruct-2506-GGUF

Image-Text-to-Text
GGUF
vllm
conversational
Model card Files
xet
Community
gabriellarson commited on
Commit
6771c89
·
verified ·
1 Parent(s): 030ce70

Upload folder using huggingface_hub

Browse files
Files changed (9) hide show
  1. .gitattributes +8 -0
  2. Mistral-Small-3.2-24B-Instruct-2506-IQ3_XS.gguf +3 -0
  3. Mistral-Small-3.2-24B-Instruct-2506-IQ4_XS.gguf +3 -0
  4. Mistral-Small-3.2-24B-Instruct-2506-Q3_K_L.gguf +3 -0
  5. Mistral-Small-3.2-24B-Instruct-2506-Q3_K_M.gguf +3 -0
  6. Mistral-Small-3.2-24B-Instruct-2506-Q3_K_S.gguf +3 -0
  7. Mistral-Small-3.2-24B-Instruct-2506-Q4_K_M.gguf +3 -0
  8. Mistral-Small-3.2-24B-Instruct-2506-Q4_K_S.gguf +3 -0
  9. Mistral-Small-3.2-24B-Instruct-2506-Q5_K_S.gguf +3 -0
.gitattributes CHANGED
@@ -48,3 +48,11 @@ Mistral-Small-3.2-24B-Instruct-2506-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -te
48
  Mistral-Small-3.2-24B-Instruct-2506-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
49
  Mistral-Small-3.2-24B-Instruct-2506-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
50
  Mistral-Small-3.2-24B-Instruct-2506-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
48
  Mistral-Small-3.2-24B-Instruct-2506-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
49
  Mistral-Small-3.2-24B-Instruct-2506-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
50
  Mistral-Small-3.2-24B-Instruct-2506-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
51
+ Mistral-Small-3.2-24B-Instruct-2506-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
52
+ Mistral-Small-3.2-24B-Instruct-2506-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
53
+ Mistral-Small-3.2-24B-Instruct-2506-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
54
+ Mistral-Small-3.2-24B-Instruct-2506-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
55
+ Mistral-Small-3.2-24B-Instruct-2506-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
56
+ Mistral-Small-3.2-24B-Instruct-2506-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
57
+ Mistral-Small-3.2-24B-Instruct-2506-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
58
+ Mistral-Small-3.2-24B-Instruct-2506-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-Small-3.2-24B-Instruct-2506-IQ3_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:68d48ec9551c5e16c75feb7de9b17b9b937ab432ae38d5a449714dbe6e70faf5
3
+ size 9907118048
Mistral-Small-3.2-24B-Instruct-2506-IQ4_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9649aa6cebe74a08372f6cf8d262da07b066cab04dbc74b4e39e849c25b91c81
3
+ size 12758917088
Mistral-Small-3.2-24B-Instruct-2506-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5cea17e550a023918ad72e0909a2a8483cdf2edac5af29b268e36ee116ec2c57
3
+ size 12400762848
Mistral-Small-3.2-24B-Instruct-2506-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:39aa004d99c0fb311b2be30bee59fb0812bd4528e1461b80478585f41db5447f
3
+ size 11474083808
Mistral-Small-3.2-24B-Instruct-2506-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9d1b4589518db0783003fcebbf718cccfda8b75780eb6dff4fcf4e6f7f79d4a5
3
+ size 10400276448
Mistral-Small-3.2-24B-Instruct-2506-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cd595574950e6dc996492d8f4fff1f9245f56d830f7dfe7879b98964af0dd57f
3
+ size 14333911008
Mistral-Small-3.2-24B-Instruct-2506-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e6f756606c9b7d4bde6d290c2b1efc73aa194256f6fdd5f7589be8d3148f3e2b
3
+ size 13549281248
Mistral-Small-3.2-24B-Instruct-2506-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2d0b7ae92f03ba0168b0c05aff3b907340de2cae6b772b7d48db9d425ccf5ae4
3
+ size 16304414688