Hugging Face's logo

mradermacher
/
amoral-gemma3-4B-v2-qat-i1-GGUF

Transformers
GGUF
English
text-generation-inference
gemma3
analytical-tasks
bias-neutralization
uncensored
imatrix
conversational
Model card Files
xet
Community
mradermacher commited on
Commit
a6db5a0
·
verified ·
1 Parent(s): 16df4f1

uploaded from nico1

Browse files
Files changed (25) hide show
  1. .gitattributes +24 -0
  2. amoral-gemma3-4B-v2-qat.i1-IQ1_M.gguf +3 -0
  3. amoral-gemma3-4B-v2-qat.i1-IQ1_S.gguf +3 -0
  4. amoral-gemma3-4B-v2-qat.i1-IQ2_M.gguf +3 -0
  5. amoral-gemma3-4B-v2-qat.i1-IQ2_S.gguf +3 -0
  6. amoral-gemma3-4B-v2-qat.i1-IQ2_XS.gguf +3 -0
  7. amoral-gemma3-4B-v2-qat.i1-IQ2_XXS.gguf +3 -0
  8. amoral-gemma3-4B-v2-qat.i1-IQ3_M.gguf +3 -0
  9. amoral-gemma3-4B-v2-qat.i1-IQ3_S.gguf +3 -0
  10. amoral-gemma3-4B-v2-qat.i1-IQ3_XS.gguf +3 -0
  11. amoral-gemma3-4B-v2-qat.i1-IQ3_XXS.gguf +3 -0
  12. amoral-gemma3-4B-v2-qat.i1-IQ4_NL.gguf +3 -0
  13. amoral-gemma3-4B-v2-qat.i1-IQ4_XS.gguf +3 -0
  14. amoral-gemma3-4B-v2-qat.i1-Q2_K.gguf +3 -0
  15. amoral-gemma3-4B-v2-qat.i1-Q2_K_S.gguf +3 -0
  16. amoral-gemma3-4B-v2-qat.i1-Q3_K_L.gguf +3 -0
  17. amoral-gemma3-4B-v2-qat.i1-Q3_K_M.gguf +3 -0
  18. amoral-gemma3-4B-v2-qat.i1-Q3_K_S.gguf +3 -0
  19. amoral-gemma3-4B-v2-qat.i1-Q4_0.gguf +3 -0
  20. amoral-gemma3-4B-v2-qat.i1-Q4_1.gguf +3 -0
  21. amoral-gemma3-4B-v2-qat.i1-Q4_K_M.gguf +3 -0
  22. amoral-gemma3-4B-v2-qat.i1-Q4_K_S.gguf +3 -0
  23. amoral-gemma3-4B-v2-qat.i1-Q5_K_M.gguf +3 -0
  24. amoral-gemma3-4B-v2-qat.i1-Q5_K_S.gguf +3 -0
  25. amoral-gemma3-4B-v2-qat.i1-Q6_K.gguf +3 -0
.gitattributes CHANGED
@@ -34,3 +34,27 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  imatrix.dat filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  imatrix.dat filter=lfs diff=lfs merge=lfs -text
37
+ amoral-gemma3-4B-v2-qat.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
38
+ amoral-gemma3-4B-v2-qat.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
39
+ amoral-gemma3-4B-v2-qat.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
40
+ amoral-gemma3-4B-v2-qat.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
41
+ amoral-gemma3-4B-v2-qat.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
42
+ amoral-gemma3-4B-v2-qat.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
43
+ amoral-gemma3-4B-v2-qat.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
44
+ amoral-gemma3-4B-v2-qat.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
45
+ amoral-gemma3-4B-v2-qat.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
46
+ amoral-gemma3-4B-v2-qat.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
47
+ amoral-gemma3-4B-v2-qat.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
48
+ amoral-gemma3-4B-v2-qat.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
49
+ amoral-gemma3-4B-v2-qat.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
50
+ amoral-gemma3-4B-v2-qat.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
51
+ amoral-gemma3-4B-v2-qat.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
52
+ amoral-gemma3-4B-v2-qat.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
53
+ amoral-gemma3-4B-v2-qat.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
54
+ amoral-gemma3-4B-v2-qat.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
55
+ amoral-gemma3-4B-v2-qat.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
56
+ amoral-gemma3-4B-v2-qat.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
57
+ amoral-gemma3-4B-v2-qat.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
58
+ amoral-gemma3-4B-v2-qat.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
59
+ amoral-gemma3-4B-v2-qat.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
60
+ amoral-gemma3-4B-v2-qat.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
amoral-gemma3-4B-v2-qat.i1-IQ1_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e95cb26c67adc5d224bbffad7944511f96a5a3fe6d4939ec44e131053ed43cae
3
+ size 1199572064
amoral-gemma3-4B-v2-qat.i1-IQ1_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:140bf8a232fe5b7472d53e472c8832d90f4ffcbceacd513358c40e5df57ccd1c
3
+ size 1133093984
amoral-gemma3-4B-v2-qat.i1-IQ2_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4e9e36fba66ee50243d60975dc5f6856daa7023f68652c66986fc96a6beefdb5
3
+ size 1537983584
amoral-gemma3-4B-v2-qat.i1-IQ2_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dee40032371fd718f0cbf7427804184ad13097e28f26b2d54314cfec13d9ea12
3
+ size 1449346144
amoral-gemma3-4B-v2-qat.i1-IQ2_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b563f11e659dea35c138a9402ecf1d90f80187e253935ddc1d291d7e757cd8bb
3
+ size 1404576864
amoral-gemma3-4B-v2-qat.i1-IQ2_XXS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:686599d0b9dfb10d922dde8e5bd94d840373e199403eee13c6472ed1afce41e4
3
+ size 1310368864
amoral-gemma3-4B-v2-qat.i1-IQ3_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b05f233b2c65a04535cf47253722072fdf0bcc92b0d1706e130d0821d4eebb0e
3
+ size 1986804064
amoral-gemma3-4B-v2-qat.i1-IQ3_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:869aa3ef13119fced797f9cc90148c7815ffe42e9ffb5ade716baceca8b2a742
3
+ size 1937365344
amoral-gemma3-4B-v2-qat.i1-IQ3_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d7184d4316bcfda6e26609ecd2a951f7d2be9dc3b4cc497abd0ed571f832657e
3
+ size 1863391584
amoral-gemma3-4B-v2-qat.i1-IQ3_XXS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c24d3c6b61a328c60ac1e1d2f6cf078d4c1dcd3bb030b4b46f2f2ff7500c5cf5
3
+ size 1689453664
amoral-gemma3-4B-v2-qat.i1-IQ4_NL.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:41d58d504db01d0523bb48ea274e07ddbaadad1720e665ece82563f990ae093b
3
+ size 2363513184
amoral-gemma3-4B-v2-qat.i1-IQ4_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ffa65e94daa428987d3b1b719dbbd4e51266f989ed06bcf48a8f0eb36d81e359
3
+ size 2263243104
amoral-gemma3-4B-v2-qat.i1-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:35199455878d99bfcb3cd4a602601b5bc5936624b1d38da5f47e76fb368825ca
3
+ size 1729165664
amoral-gemma3-4B-v2-qat.i1-Q2_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1f7b02cf0c4558c948c19c24e0902954ed2f86850548c89f027550830c362b26
3
+ size 1636063584
amoral-gemma3-4B-v2-qat.i1-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:78d05c3fa30bd97d978e73fb541777b1d3ec417f0cce9929bb343d96d7a52627
3
+ size 2236086624
amoral-gemma3-4B-v2-qat.i1-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:25da6b0f7dd4286de83b12574cfa4a88d7834eb0a75f545c1d089695bca0dc0b
3
+ size 2098461024
amoral-gemma3-4B-v2-qat.i1-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:35b46d5ea92502d6bdd2ef50cbf33586e067f1754a08dce37e751f2e38e8577b
3
+ size 1937365344
amoral-gemma3-4B-v2-qat.i1-Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a76ba769d70b131fd5c4de5929dcc85b14078cb456e7deed933c729e40fa3f47
3
+ size 2370066784
amoral-gemma3-4B-v2-qat.i1-Q4_1.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d13820f041610442aa813525bd69c6b892c91fb6439dc2f414f0c622d0cf6a99
3
+ size 2564053344
amoral-gemma3-4B-v2-qat.i1-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:33eece6a823e9744c3d92da0636032aa8ff0a38b35b5244ba5fb721a9e472f35
3
+ size 2489895264
amoral-gemma3-4B-v2-qat.i1-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c95e8f33dff1554297170a0a28143c08d3cf32b479480f744ca88a0758f992f8
3
+ size 2377931104
amoral-gemma3-4B-v2-qat.i1-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8624679675b4054065627f08ee007324d67e2f376d90392e34396d4dd82b4fcb
3
+ size 2829699424
amoral-gemma3-4B-v2-qat.i1-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:649ee1f8aa2fb72dcd2d18e2b37787481ea47e7a036f1d2a9069c077f37ae2f2
3
+ size 2764593504
amoral-gemma3-4B-v2-qat.i1-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:618ca1305cc4bd96261f8421ad07236e714c34b022a453358a6fac4e2198905c
3
+ size 3190741344