Hugging Face's logo

MaziyarPanahi
/
gemma-7b-GGUF

Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
gemma
arxiv:2305.14314
arxiv:2312.11805
arxiv:2009.03300
arxiv:1905.07830
arxiv:1911.11641
arxiv:1904.09728
arxiv:1905.10044
arxiv:1907.10641
arxiv:1811.00937
arxiv:1809.02789
arxiv:1911.01547
arxiv:1705.03551
arxiv:2107.03374
arxiv:2108.07732
arxiv:2110.14168
arxiv:2304.06364
arxiv:2206.04615
arxiv:1804.06876
arxiv:2110.08193
arxiv:2009.11462
arxiv:2101.11718
arxiv:1804.09301
arxiv:2109.07958
arxiv:2203.09509
Inference Endpoints
has_space
text-generation-inference
Model card Files Community
5
MaziyarPanahi commited on
Commit
9407ac9
•
1 Parent(s): fb75958

Upload folder using huggingface_hub

Browse files
Files changed (13) hide show
  1. .gitattributes +11 -0
  2. README.md +1 -0
  3. gemma-7b.Q2_K.gguf +3 -0
  4. gemma-7b.Q3_K_L.gguf +3 -0
  5. gemma-7b.Q3_K_M.gguf +3 -0
  6. gemma-7b.Q3_K_S.gguf +3 -0
  7. gemma-7b.Q4_K_M.gguf +3 -0
  8. gemma-7b.Q4_K_S.gguf +3 -0
  9. gemma-7b.Q5_K_M.gguf +3 -0
  10. gemma-7b.Q5_K_S.gguf +3 -0
  11. gemma-7b.Q6_K.gguf +3 -0
  12. gemma-7b.Q8_0.gguf +3 -0
  13. gemma-7b.fp16.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,14 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ gemma-7b.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
37
+ gemma-7b.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
38
+ gemma-7b.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
39
+ gemma-7b.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
40
+ gemma-7b.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
41
+ gemma-7b.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
42
+ gemma-7b.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
43
+ gemma-7b.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
44
+ gemma-7b.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
45
+ gemma-7b.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
46
+ gemma-7b.fp16.gguf filter=lfs diff=lfs merge=lfs -text
README.md CHANGED
@@ -37,6 +37,7 @@ tags:
37
  - arxiv:1804.09301
38
  - arxiv:2109.07958
39
  - arxiv:2203.09509
 
40
  - autotrain_compatible
41
  - endpoints_compatible
42
  - has_space
 
37
  - arxiv:1804.09301
38
  - arxiv:2109.07958
39
  - arxiv:2203.09509
40
+ - license:other
41
  - autotrain_compatible
42
  - endpoints_compatible
43
  - has_space
gemma-7b.Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fd3c06a8200fc8bd9fd7e6678bb9b5e70d836fa0b405a7bc9d1f0f5b4d17a27b
3
+ size 3094507680
gemma-7b.Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7837fb5e6d01b87ba5cf02194a9df0bda681902e1c210bdb752312c42e144b04
3
+ size 4402039968
gemma-7b.Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:991a15d5661a2e42d9c8aba486659c8a43951053a650e575b2edae101b15e576
3
+ size 4062301344
gemma-7b.Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5875b87b4a38aab15788f3bbd16919d8e1a2e8ed6b243109e5a4f4fcaedae8af
3
+ size 3675376800
gemma-7b.Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:055d07a2b61e83b8d23198b6d0bd4c2b60848033d23bad648675c62f23eacdea
3
+ size 5127231648
gemma-7b.Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a197785f5d49af20991015dcd62df83c0c87f7aab2ff56a032ea8a54002ddfd7
3
+ size 4843919520
gemma-7b.Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:80e14c828b57b0e0cf739c7c34c35c67e47f2a43ad473a6fff35d2d8ce2a4592
3
+ size 6040328352
gemma-7b.Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0d74e4662fd18f428415641961d52126eb307efe4d1ac210f4785046e8864cc4
3
+ size 5876553888
gemma-7b.Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:93ea627826289539068817d044b87c523222f3e2b3d0d10176bac34292bce188
3
+ size 7010493600
gemma-7b.Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7f72310ab83b94033356b9491f37b0a0036a16c47a65307439862cdbb3462aa5
3
+ size 9078266016
gemma-7b.fp16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b1f4aabd3db466eb1c8ff792efa7647cf02e56202574b9cdd555c2df32d5af43
3
+ size 34158344288