Hugging Face's logo

gabriellarson
/
Devstral-Small-2507-GGUF

Text Generation
GGUF
vllm
text2text-generation
imatrix
conversational
Model card Files
xet
Community
gabriellarson commited on
Commit
f946505
·
verified ·
1 Parent(s): 772cd24

Upload folder using huggingface_hub

Browse files
Files changed (4) hide show
  1. .gitattributes +3 -0
  2. Devstral-Small-2507-IQ3_M.gguf +3 -0
  3. Devstral-Small-2507-IQ3_S.gguf +3 -0
  4. Devstral-Small-2507-IQ3_XXS.gguf +3 -0
.gitattributes CHANGED
@@ -53,3 +53,6 @@ Devstral-Small-2507-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
53
  Devstral-Small-2507-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
54
  Devstral-Small-2507-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
55
  mmproj-Devstral-Small-2507.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
53
  Devstral-Small-2507-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
54
  Devstral-Small-2507-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
55
  mmproj-Devstral-Small-2507.gguf filter=lfs diff=lfs merge=lfs -text
56
+ Devstral-Small-2507-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
57
+ Devstral-Small-2507-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
58
+ Devstral-Small-2507-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Devstral-Small-2507-IQ3_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b9f3cea5389c359bab5006b1659cc01359f8807add395ce50c86b3557700df59
3
+ size 10650958912
Devstral-Small-2507-IQ3_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e0a73130ca47d9c42bb9e0094a088dd76b75cedf7bfd7c366f1e5ba4fd9db5ae
3
+ size 10428136512
Devstral-Small-2507-IQ3_XXS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b93a7c16ba876e675fc5fe66bae7c1b19fda8ab4b369bfc12a32dd3efd254b68
3
+ size 9280601152