Hugging Face's logo

lewiswatson
/
Qwen2.5-3B-Instruct_Johnny_Silverhand_Merged-GGUF

Transformers
GGUF
conversational
Model card Files
xet
Community
lewiswatson commited on
Commit
9526e2f
·
verified ·
1 Parent(s): d97f322

Upload GGUF quantised models

Browse files
Files changed (14) hide show
  1. .gitattributes +12 -0
  2. Qwen2.5-3B-Instruct_Johnny_Silverhand_Merged.IQ4_XS.gguf +3 -0
  3. Qwen2.5-3B-Instruct_Johnny_Silverhand_Merged.Q2_K.gguf +3 -0
  4. Qwen2.5-3B-Instruct_Johnny_Silverhand_Merged.Q3_K_L.gguf +3 -0
  5. Qwen2.5-3B-Instruct_Johnny_Silverhand_Merged.Q3_K_M.gguf +3 -0
  6. Qwen2.5-3B-Instruct_Johnny_Silverhand_Merged.Q3_K_S.gguf +3 -0
  7. Qwen2.5-3B-Instruct_Johnny_Silverhand_Merged.Q4_K_M.gguf +3 -0
  8. Qwen2.5-3B-Instruct_Johnny_Silverhand_Merged.Q4_K_S.gguf +3 -0
  9. Qwen2.5-3B-Instruct_Johnny_Silverhand_Merged.Q5_K_M.gguf +3 -0
  10. Qwen2.5-3B-Instruct_Johnny_Silverhand_Merged.Q5_K_S.gguf +3 -0
  11. Qwen2.5-3B-Instruct_Johnny_Silverhand_Merged.Q6_K.gguf +3 -0
  12. Qwen2.5-3B-Instruct_Johnny_Silverhand_Merged.Q8_0.gguf +3 -0
  13. Qwen2.5-3B-Instruct_Johnny_Silverhand_Merged.f16.gguf +3 -0
  14. README.md +37 -0
.gitattributes CHANGED
@@ -33,3 +33,15 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ Qwen2.5-3B-Instruct_Johnny_Silverhand_Merged.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
37
+ Qwen2.5-3B-Instruct_Johnny_Silverhand_Merged.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
38
+ Qwen2.5-3B-Instruct_Johnny_Silverhand_Merged.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Qwen2.5-3B-Instruct_Johnny_Silverhand_Merged.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Qwen2.5-3B-Instruct_Johnny_Silverhand_Merged.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
41
+ Qwen2.5-3B-Instruct_Johnny_Silverhand_Merged.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
42
+ Qwen2.5-3B-Instruct_Johnny_Silverhand_Merged.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
43
+ Qwen2.5-3B-Instruct_Johnny_Silverhand_Merged.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
44
+ Qwen2.5-3B-Instruct_Johnny_Silverhand_Merged.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
45
+ Qwen2.5-3B-Instruct_Johnny_Silverhand_Merged.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
46
+ Qwen2.5-3B-Instruct_Johnny_Silverhand_Merged.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
47
+ Qwen2.5-3B-Instruct_Johnny_Silverhand_Merged.f16.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-3B-Instruct_Johnny_Silverhand_Merged.IQ4_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:84d569bdf806b6ae3d6e7255c32ac9486cfa1f8e9720961f3e87ef2ee9b6d67a
3
+ size 1753184736
Qwen2.5-3B-Instruct_Johnny_Silverhand_Merged.Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:83371b443083106cfd1523204635393071adda2c507f0568fc4d9aeca2157b25
3
+ size 1274755552
Qwen2.5-3B-Instruct_Johnny_Silverhand_Merged.Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f28d0a9e64aa34b0dc0fc1e55247b6cadbf184a895f4e840ac44183ec346b3ea
3
+ size 1707391456
Qwen2.5-3B-Instruct_Johnny_Silverhand_Merged.Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b7f6547abb7e467b7d1f27a36f6345618e9d2c024ce1cac4caa74cc1a3796fab
3
+ size 1590475232
Qwen2.5-3B-Instruct_Johnny_Silverhand_Merged.Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3d0c91127e23f24c61ee4b44db41954703f691363dfa664ae55d7764c9eddc54
3
+ size 1454356960
Qwen2.5-3B-Instruct_Johnny_Silverhand_Merged.Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bff389560d9807372b6de2fa60fd62170d2f6c4dc65a2c343c4856a7d2bda239
3
+ size 1929902560
Qwen2.5-3B-Instruct_Johnny_Silverhand_Merged.Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:525acac85ebdef6fd2da880a17ec4cf9f228512dc0134b5e536e054303149388
3
+ size 1834383840
Qwen2.5-3B-Instruct_Johnny_Silverhand_Merged.Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:06dfd2d219cbe3043dd560d9dc0b292e59c5e2dbd368b21988609fdf286d294f
3
+ size 2224814560
Qwen2.5-3B-Instruct_Johnny_Silverhand_Merged.Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9fa2ea0022d7d190933d8ccfb397a3391d53b3972e030d2a77fe593ba7e40c5e
3
+ size 2169666016
Qwen2.5-3B-Instruct_Johnny_Silverhand_Merged.Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:99488b6ed58dee5f135a524465696b48884e2053c3d00a71e61d67bb96d2b3ea
3
+ size 2538158560
Qwen2.5-3B-Instruct_Johnny_Silverhand_Merged.Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b964dd68364c975dd1b7a0e0e7835a51328eddd63487bd582bae0b88ae0ac767
3
+ size 3285475808
Qwen2.5-3B-Instruct_Johnny_Silverhand_Merged.f16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5d67a96fff6bb0bf64a1c23e9619f6f57516077bbc1fe43a35ef253bab5883b5
3
+ size 6178316768
README.md ADDED
@@ -0,0 +1,37 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: cc-by-nc-4.0
3
+ library_name: transformers
4
+ tags:
5
+ - gguf
6
+ base_model: lewiswatson/Qwen2.5-3B-Instruct_Johnny_Silverhand_Merged-GGUF
7
+ ---
8
+
9
+ # GGUF Quantised Models for Qwen2.5-3B-Instruct_Johnny_Silverhand_Merged
10
+
11
+ This repository contains GGUF format model files for `lewiswatson/Qwen2.5-3B-Instruct_Johnny_Silverhand_Merged-GGUF`, quantised.
12
+
13
+ ## Original Model
14
+
15
+ The original fine-tuned model used to generate these quantisations can be found here:
16
+ [lewiswatson/Qwen2.5-3B-Instruct_Johnny_Silverhand_Merged-GGUF](https://huggingface.co/lewiswatson/Qwen2.5-3B-Instruct_Johnny_Silverhand_Merged-GGUF)
17
+
18
+ ## Provided Files (GGUF)
19
+
20
+ | File | Size |
21
+ |----------------------------|------|
22
+ | `Qwen2.5-3B-Instruct_Johnny_Silverhand_Merged.IQ4_XS.gguf` | 1.63 GB |
23
+ | `Qwen2.5-3B-Instruct_Johnny_Silverhand_Merged.Q2_K.gguf` | 1.19 GB |
24
+ | `Qwen2.5-3B-Instruct_Johnny_Silverhand_Merged.Q3_K_L.gguf` | 1.59 GB |
25
+ | `Qwen2.5-3B-Instruct_Johnny_Silverhand_Merged.Q3_K_M.gguf` | 1.48 GB |
26
+ | `Qwen2.5-3B-Instruct_Johnny_Silverhand_Merged.Q3_K_S.gguf` | 1.35 GB |
27
+ | `Qwen2.5-3B-Instruct_Johnny_Silverhand_Merged.Q4_K_M.gguf` | 1.80 GB |
28
+ | `Qwen2.5-3B-Instruct_Johnny_Silverhand_Merged.Q4_K_S.gguf` | 1.71 GB |
29
+ | `Qwen2.5-3B-Instruct_Johnny_Silverhand_Merged.Q5_K_M.gguf` | 2.07 GB |
30
+ | `Qwen2.5-3B-Instruct_Johnny_Silverhand_Merged.Q5_K_S.gguf` | 2.02 GB |
31
+ | `Qwen2.5-3B-Instruct_Johnny_Silverhand_Merged.Q6_K.gguf` | 2.36 GB |
32
+ | `Qwen2.5-3B-Instruct_Johnny_Silverhand_Merged.Q8_0.gguf` | 3.06 GB |
33
+ | `Qwen2.5-3B-Instruct_Johnny_Silverhand_Merged.f16.gguf` | 5.75 GB |
34
+
35
+
36
+ ---
37
+ *This repository was automatically created using a script on 2025-04-14.*