Hugging Face's logo

gabriellarson
/
Mistral-Small-3.2-24B-Instruct-2506-GGUF

Image-Text-to-Text
GGUF
vllm
conversational
Model card Files
xet
Community
gabriellarson commited on
Commit
030ce70
·
verified ·
1 Parent(s): 6b0d7bf

Upload folder using huggingface_hub

Browse files
Files changed (10) hide show
  1. .gitattributes +9 -0
  2. Mistral-Small-3.2-24B-Instruct-2506-IQ1_M.gguf +3 -0
  3. Mistral-Small-3.2-24B-Instruct-2506-IQ1_S.gguf +3 -0
  4. Mistral-Small-3.2-24B-Instruct-2506-IQ2_M.gguf +3 -0
  5. Mistral-Small-3.2-24B-Instruct-2506-IQ2_S.gguf +3 -0
  6. Mistral-Small-3.2-24B-Instruct-2506-IQ3_M.gguf +3 -0
  7. Mistral-Small-3.2-24B-Instruct-2506-IQ3_S.gguf +3 -0
  8. Mistral-Small-3.2-24B-Instruct-2506-IQ3_XXS.gguf +3 -0
  9. Mistral-Small-3.2-24B-Instruct-2506-Q2_K.gguf +3 -0
  10. Mistral-Small-3.2-24B-Instruct-2506-Q2_K_S.gguf +3 -0
.gitattributes CHANGED
@@ -39,3 +39,12 @@ Mistral-Small-3.2-24B-Instruct-2506-Q4_0.gguf filter=lfs diff=lfs merge=lfs -tex
39
  Mistral-Small-3.2-24B-Instruct-2506-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
40
  Mistral-Small-3.2-24B-Instruct-2506-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
41
  Mistral-Small-3.2-24B-Instruct-2506-Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
39
  Mistral-Small-3.2-24B-Instruct-2506-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
40
  Mistral-Small-3.2-24B-Instruct-2506-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
41
  Mistral-Small-3.2-24B-Instruct-2506-Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
42
+ Mistral-Small-3.2-24B-Instruct-2506-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
43
+ Mistral-Small-3.2-24B-Instruct-2506-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
44
+ Mistral-Small-3.2-24B-Instruct-2506-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
45
+ Mistral-Small-3.2-24B-Instruct-2506-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
46
+ Mistral-Small-3.2-24B-Instruct-2506-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
47
+ Mistral-Small-3.2-24B-Instruct-2506-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
48
+ Mistral-Small-3.2-24B-Instruct-2506-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
49
+ Mistral-Small-3.2-24B-Instruct-2506-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
50
+ Mistral-Small-3.2-24B-Instruct-2506-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-Small-3.2-24B-Instruct-2506-IQ1_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f5c6514999901aa495db6e8cd3c1f0f260db3ea4e910d7730185201c65c3450d
3
+ size 5750497248
Mistral-Small-3.2-24B-Instruct-2506-IQ1_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c71b83f5ed3ae38247bd387dd89aefa4f9005a5c906a5c561b87adb59202f6c4
3
+ size 5273722848
Mistral-Small-3.2-24B-Instruct-2506-IQ2_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bf620936515a4e1f7fdbb31e25eeeecc7cbde26daf50f8b4e7da1cea08ec25f8
3
+ size 8114053088
Mistral-Small-3.2-24B-Instruct-2506-IQ2_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:11f945c6b59c37607d41c55eef978d4649ac9c546b2e9d16fdf54cd7f80d1099
3
+ size 7478353888
Mistral-Small-3.2-24B-Instruct-2506-IQ3_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:71ff3cfb2c8002b625b156cd045e61199a0671b8b89b22a68dd62f1bf67ce79b
3
+ size 10650951648
Mistral-Small-3.2-24B-Instruct-2506-IQ3_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:454eb8d12593dda05d8383899c7c590772088e51563c0a813b69d34d5c058cad
3
+ size 10428129248
Mistral-Small-3.2-24B-Instruct-2506-IQ3_XXS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4cb459fdac517f77a6a1ebdf2e7f0361fea3b3eeacaf576f5ee952b90dcdf597
3
+ size 9280593888
Mistral-Small-3.2-24B-Instruct-2506-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3e3eef275c3b89cd18f9a0fbb95b9092b114f83bfdc49b61c8901eeca2f01678
3
+ size 8890327008
Mistral-Small-3.2-24B-Instruct-2506-Q2_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c6453998e0e96efee132617bd60cc9d5ae131ce66240372d1067ad7e145eacc1
3
+ size 8320163808