Hugging Face's logo

gabriellarson
/
Devstral-Small-2507-GGUF

Text Generation
GGUF
vllm
text2text-generation
imatrix
conversational
Model card Files
xet
Community
gabriellarson commited on
Commit
c38b910
·
verified ·
1 Parent(s): e91923a

Upload folder using huggingface_hub

Browse files
Files changed (4) hide show
  1. .gitattributes +3 -0
  2. Devstral-Small-2507-Q5_K_M.gguf +3 -0
  3. Devstral-Small-2507-Q6_K.gguf +3 -0
  4. Devstral-Small-2507-Q8_0.gguf +3 -0
.gitattributes CHANGED
@@ -61,3 +61,6 @@ Devstral-Small-2507-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
61
  Devstral-Small-2507-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
62
  Devstral-Small-2507-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
63
  Devstral-Small-2507-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
61
  Devstral-Small-2507-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
62
  Devstral-Small-2507-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
63
  Devstral-Small-2507-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
64
+ Devstral-Small-2507-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
65
+ Devstral-Small-2507-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
66
+ Devstral-Small-2507-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
Devstral-Small-2507-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5960bbfaef929427a340a04bbb976e820ecb84c0a5661770dee7ecc4f011c047
3
+ size 16763993152
Devstral-Small-2507-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:882af7dcba3a8f90e6e8864a0cb317e70893761a6a12f845fc7abb519531aef7
3
+ size 19345947712
Devstral-Small-2507-Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:28b897a6ae4de17717a15d8b4ae0341b93d8dbc4c5661c7f9c624a8665946ed9
3
+ size 25054788672