Hugging Face's logo

second-state
/
Qwen2.5-3B-Instruct-GGUF

Text Generation
GGUF
English
qwen2
chat
Inference Endpoints
conversational
Model card Files Community
apepkuss79 commited on
Commit
815db63
·
verified ·
1 Parent(s): fdb6e44

Update models

Browse files
Files changed (13) hide show
  1. Qwen2.5-3B-Instruct-Q2_K.gguf +1 -1
  2. Qwen2.5-3B-Instruct-Q3_K_L.gguf +1 -1
  3. Qwen2.5-3B-Instruct-Q3_K_M.gguf +1 -1
  4. Qwen2.5-3B-Instruct-Q3_K_S.gguf +1 -1
  5. Qwen2.5-3B-Instruct-Q4_0.gguf +1 -1
  6. Qwen2.5-3B-Instruct-Q4_K_M.gguf +1 -1
  7. Qwen2.5-3B-Instruct-Q4_K_S.gguf +1 -1
  8. Qwen2.5-3B-Instruct-Q5_0.gguf +1 -1
  9. Qwen2.5-3B-Instruct-Q5_K_M.gguf +1 -1
  10. Qwen2.5-3B-Instruct-Q5_K_S.gguf +1 -1
  11. Qwen2.5-3B-Instruct-Q6_K.gguf +1 -1
  12. Qwen2.5-3B-Instruct-Q8_0.gguf +1 -1
  13. Qwen2.5-3B-Instruct-f16.gguf +1 -1
Qwen2.5-3B-Instruct-Q2_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e18ae976d78da4ed90935fe7c23fdd16fe9101bb5d3fc586ba6453054d43e3a5
3
  size 1274756000
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a577f509a29d9b4bc245b98df2e69ba3292b2df50d42c4657e9c4bca457788b2
3
  size 1274756000
Qwen2.5-3B-Instruct-Q3_K_L.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c58ac1b9534eeb580ce2a8189dbd1820b4889d710ef986249defda98dcf3a993
3
  size 1707391904
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b9759572d3a1db6a77b9c1bf3bbea889c9542fc40efcf87bdd55a3496764ef0a
3
  size 1707391904
Qwen2.5-3B-Instruct-Q3_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3aad7bf9d708f0ccacb974b54a2c584ecbb2bc07b7f63d5c42e0e469814f0f2d
3
  size 1590475680
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4347bd83febdfe63d50e65ceb67470cfc92df6719fa850df485028197575438d
3
  size 1590475680
Qwen2.5-3B-Instruct-Q3_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:66e5c520e2655555cb77392ee83369e5373e5b421dba8841a2f9449984c2c12f
3
  size 1454357408
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2504afaf19bb90519ef9faac4287bf806dfac73137b44b538934f91872b7e940
3
  size 1454357408
Qwen2.5-3B-Instruct-Q4_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a4ec95864fc1a2023d58c2d77280b6318c1ef29f7bbc0fd459bd2b10998bb3c8
3
  size 1822849952
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:15c1644cfaefc7c0acad847e569d2f8d6699627ff7c69850c1135249004a0297
3
  size 1822849952
Qwen2.5-3B-Instruct-Q4_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0ef20255e2a9a97b5980fe72ccdc2a90af460754be0e48fec3ad3225044995ea
3
  size 1929903008
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5f84e8620223fbf57de40f88b805e6d0cd5d7d7398195a1b9734216822e3321b
3
  size 1929903008
Qwen2.5-3B-Instruct-Q4_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:fd5d0a3401311599dda08b128d0541b3ddf2789b04cd1a7d9f2a052da6d698e9
3
  size 1834384288
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:834a6f319c6928eb91c6564e4af31acf9f3e298b5292dde342c3c23f1b1f06f6
3
  size 1834384288
Qwen2.5-3B-Instruct-Q5_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:cacc2a00a02eb8dcdea9513a00c0f6e02898c1b2dff823866c161a31c45eb6bd
3
  size 2169666464
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:59ab3018fbd912bdca266991f9e5ea52b33dc9fefd875bfe19e55672ae9e0c2e
3
  size 2169666464
Qwen2.5-3B-Instruct-Q5_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:397ad8b7302b9f7fa11479615ac01f8f82a4a33e16e16618d22eac9b3d557646
3
  size 2224815008
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d411298f8f11fc3966565f0dbf87ec71d834a31b8ebe8b27e9b38fe429f18518
3
  size 2224815008
Qwen2.5-3B-Instruct-Q5_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:377ffd419397fb20f4c1f194c1c8b9a178e1849b2aedf96914d3610db658e16c
3
  size 2169666464
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1b213f5da25a896cd0050d0bdc4246f4072040a520302915a8fa48f5c88b193b
3
  size 2169666464
Qwen2.5-3B-Instruct-Q6_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d05f445726ce852987659a18f407455268476188e77a0fd57ef99328fe63ad2f
3
  size 2538159008
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e3adcd3fa24fd2728b211da61c033a153b73557399bd642f44c4f4d7cca43ef3
3
  size 2538159008
Qwen2.5-3B-Instruct-Q8_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4420ccb0f1d9e12811d04ae2a28ec881469305f813c62d86c10e595ef8e0111d
3
  size 3285476256
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b337380c65b7188868882c790bb437976329792fd60752e762c98ef5bb60fdde
3
  size 3285476256
Qwen2.5-3B-Instruct-f16.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:bfa0216b48c79e4518d5c69ee572eaf8b517892a19048b9e7388fb1442165cdb
3
  size 6178317216
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:25908e409af8c952a17c8fda44b90e699565a90436431574f44c25d140aa5032
3
  size 6178317216