Hugging Face's logo

lewiswatson
/
Qwen2.5_14B_Instruct_Johnny_Silverhand_Merged-GGUF

Transformers
GGUF
conversational
Model card Files Community
lewiswatson commited on
Commit
c85f490
·
verified ·
1 Parent(s): f363a9f

Upload GGUF quantised models

Browse files
Files changed (14) hide show
  1. .gitattributes +12 -0
  2. Qwen2.5-14B-Instruct_Johnny_Silverhand_Merged.IQ4_XS.gguf +3 -0
  3. Qwen2.5-14B-Instruct_Johnny_Silverhand_Merged.Q2_K.gguf +3 -0
  4. Qwen2.5-14B-Instruct_Johnny_Silverhand_Merged.Q3_K_L.gguf +3 -0
  5. Qwen2.5-14B-Instruct_Johnny_Silverhand_Merged.Q3_K_M.gguf +3 -0
  6. Qwen2.5-14B-Instruct_Johnny_Silverhand_Merged.Q3_K_S.gguf +3 -0
  7. Qwen2.5-14B-Instruct_Johnny_Silverhand_Merged.Q4_K_M.gguf +3 -0
  8. Qwen2.5-14B-Instruct_Johnny_Silverhand_Merged.Q4_K_S.gguf +3 -0
  9. Qwen2.5-14B-Instruct_Johnny_Silverhand_Merged.Q5_K_M.gguf +3 -0
  10. Qwen2.5-14B-Instruct_Johnny_Silverhand_Merged.Q5_K_S.gguf +3 -0
  11. Qwen2.5-14B-Instruct_Johnny_Silverhand_Merged.Q6_K.gguf +3 -0
  12. Qwen2.5-14B-Instruct_Johnny_Silverhand_Merged.Q8_0.gguf +3 -0
  13. Qwen2.5-14B-Instruct_Johnny_Silverhand_Merged.f16.gguf +3 -0
  14. README.md +37 -0
.gitattributes CHANGED
@@ -33,3 +33,15 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ Qwen2.5-14B-Instruct_Johnny_Silverhand_Merged.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
37
+ Qwen2.5-14B-Instruct_Johnny_Silverhand_Merged.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
38
+ Qwen2.5-14B-Instruct_Johnny_Silverhand_Merged.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Qwen2.5-14B-Instruct_Johnny_Silverhand_Merged.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Qwen2.5-14B-Instruct_Johnny_Silverhand_Merged.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
41
+ Qwen2.5-14B-Instruct_Johnny_Silverhand_Merged.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
42
+ Qwen2.5-14B-Instruct_Johnny_Silverhand_Merged.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
43
+ Qwen2.5-14B-Instruct_Johnny_Silverhand_Merged.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
44
+ Qwen2.5-14B-Instruct_Johnny_Silverhand_Merged.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
45
+ Qwen2.5-14B-Instruct_Johnny_Silverhand_Merged.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
46
+ Qwen2.5-14B-Instruct_Johnny_Silverhand_Merged.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
47
+ Qwen2.5-14B-Instruct_Johnny_Silverhand_Merged.f16.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-14B-Instruct_Johnny_Silverhand_Merged.IQ4_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ff3096fb319ffb6f6fd4901e31c8594a9d63774ca929ba89e72d7914df636104
3
+ size 8186195424
Qwen2.5-14B-Instruct_Johnny_Silverhand_Merged.Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:510a1bf66e614d1b4fc8d755dabf9c323556388d749939e298f3b906fdcff3c6
3
+ size 5770497504
Qwen2.5-14B-Instruct_Johnny_Silverhand_Merged.Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:28a905d3dc6a2a53a1adaef324cdf7b8acc3a9d59a938136865cd97460808510
3
+ size 7924768224
Qwen2.5-14B-Instruct_Johnny_Silverhand_Merged.Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f7341823a31582969b9333d75424ed5e31465b09b4d716fa134b45a2adf55867
3
+ size 7339204064
Qwen2.5-14B-Instruct_Johnny_Silverhand_Merged.Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:df0d2e33dec5b5bfc5284eec58fbd7b22fd003ccb5517b254b94fc14dd7c04d5
3
+ size 6659595744
Qwen2.5-14B-Instruct_Johnny_Silverhand_Merged.Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:db1351587a26ecf04142e951c99b58a4c7f073d89c2189b2a9d82c163cf3d837
3
+ size 8988110304
Qwen2.5-14B-Instruct_Johnny_Silverhand_Merged.Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f68e93104649816fd84876160ca73292dd5b2812109ceabf41ff8c54795c9b11
3
+ size 8573431264
Qwen2.5-14B-Instruct_Johnny_Silverhand_Merged.Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cbe7b8b3d0966af897f74e2644ab256869e011c677cfb0e722f4e584f553579b
3
+ size 10508873184
Qwen2.5-14B-Instruct_Johnny_Silverhand_Merged.Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f0e040358af51abc2b5ed89293cf99829e3c3d157f7305e3bf1411d16a19992b
3
+ size 10266553824
Qwen2.5-14B-Instruct_Johnny_Silverhand_Merged.Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:121996cff5866436a60b7b28c5a1f8bd3d4fa3ef8f9730ec4b955ef79f4f146b
3
+ size 12124683744
Qwen2.5-14B-Instruct_Johnny_Silverhand_Merged.Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:52baf3203222efef41a8c364c3dfa7e9ca0709c88e04a2faaf8e863c1402b9cc
3
+ size 15701597664
Qwen2.5-14B-Instruct_Johnny_Silverhand_Merged.f16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:985cd771cd78acdfd30e04965e3dd8508de50af7844caeea75ed56670ee32efd
3
+ size 29547716064
README.md ADDED
@@ -0,0 +1,37 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: cc-by-nc-4.0
3
+ library_name: transformers
4
+ tags:
5
+ - gguf
6
+ base_model: lewiswatson/Qwen2.5_14B_Instruct_Johnny_Silverhand_Merged-GGUF
7
+ ---
8
+
9
+ # GGUF Quantised Models for Qwen2.5_14B_Instruct_Johnny_Silverhand_Merged
10
+
11
+ This repository contains GGUF format model files for `lewiswatson/Qwen2.5_14B_Instruct_Johnny_Silverhand_Merged-GGUF`, quantised.
12
+
13
+ ## Original Model
14
+
15
+ The original fine-tuned model used to generate these quantisations can be found here:
16
+ [lewiswatson/Qwen2.5_14B_Instruct_Johnny_Silverhand_Merged-GGUF](https://huggingface.co/lewiswatson/Qwen2.5_14B_Instruct_Johnny_Silverhand_Merged-GGUF)
17
+
18
+ ## Provided Files (GGUF)
19
+
20
+ | File | Size |
21
+ |----------------------------|------|
22
+ | `Qwen2.5-14B-Instruct_Johnny_Silverhand_Merged.IQ4_XS.gguf` | 7.62 GB |
23
+ | `Qwen2.5-14B-Instruct_Johnny_Silverhand_Merged.Q2_K.gguf` | 5.37 GB |
24
+ | `Qwen2.5-14B-Instruct_Johnny_Silverhand_Merged.Q3_K_L.gguf` | 7.38 GB |
25
+ | `Qwen2.5-14B-Instruct_Johnny_Silverhand_Merged.Q3_K_M.gguf` | 6.84 GB |
26
+ | `Qwen2.5-14B-Instruct_Johnny_Silverhand_Merged.Q3_K_S.gguf` | 6.20 GB |
27
+ | `Qwen2.5-14B-Instruct_Johnny_Silverhand_Merged.Q4_K_M.gguf` | 8.37 GB |
28
+ | `Qwen2.5-14B-Instruct_Johnny_Silverhand_Merged.Q4_K_S.gguf` | 7.98 GB |
29
+ | `Qwen2.5-14B-Instruct_Johnny_Silverhand_Merged.Q5_K_M.gguf` | 9.79 GB |
30
+ | `Qwen2.5-14B-Instruct_Johnny_Silverhand_Merged.Q5_K_S.gguf` | 9.56 GB |
31
+ | `Qwen2.5-14B-Instruct_Johnny_Silverhand_Merged.Q6_K.gguf` | 11.29 GB |
32
+ | `Qwen2.5-14B-Instruct_Johnny_Silverhand_Merged.Q8_0.gguf` | 14.62 GB |
33
+ | `Qwen2.5-14B-Instruct_Johnny_Silverhand_Merged.f16.gguf` | 27.52 GB |
34
+
35
+
36
+ ---
37
+ *This repository was automatically created using a script on 2025-04-15.*