Hugging Face's logo

allenai
/
OLMoE-1B-7B-0924-GGUF

GGUF
English
Mixture of Experts
olmo
olmoe
Inference Endpoints
Model card Files Community
shanearora commited on
Commit
1b8999c
•
1 Parent(s): c202235

Upload folder using huggingface_hub

Browse files
Files changed (13) hide show
  1. olmoe-1b-7b-0924-f16.gguf +3 -0
  2. olmoe-1b-7b-0924-q2_k.gguf +3 -0
  3. olmoe-1b-7b-0924-q3_k_l.gguf +3 -0
  4. olmoe-1b-7b-0924-q3_k_m.gguf +3 -0
  5. olmoe-1b-7b-0924-q3_k_s.gguf +3 -0
  6. olmoe-1b-7b-0924-q4_0.gguf +3 -0
  7. olmoe-1b-7b-0924-q4_k_m.gguf +3 -0
  8. olmoe-1b-7b-0924-q4_k_s.gguf +3 -0
  9. olmoe-1b-7b-0924-q5_0.gguf +3 -0
  10. olmoe-1b-7b-0924-q5_k_m.gguf +3 -0
  11. olmoe-1b-7b-0924-q5_k_s.gguf +3 -0
  12. olmoe-1b-7b-0924-q6_k.gguf +3 -0
  13. olmoe-1b-7b-0924-q8_0.gguf +3 -0
olmoe-1b-7b-0924-f16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:893424707d060dc852dc2308432798655f0385e96e65774d00019810cd5395b9
3
+ size 13844565600
olmoe-1b-7b-0924-q2_k.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:65cd555f7c31f9097503cd973ba211cdd536d97784bf50c372c00f1b5a8caecf
3
+ size 2562762336
olmoe-1b-7b-0924-q3_k_l.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b6e331fcc4f4a4e37c2596a3437014d5426a047d2a82160f22a07e40e8569f08
3
+ size 3611315808
olmoe-1b-7b-0924-q3_k_m.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:958673da218c4e2e1fb88eb55d78f8f27b25a58eda8579bbea7f95747b674304
3
+ size 3343928928
olmoe-1b-7b-0924-q3_k_s.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0eb24a9224998751e94e185dad665d769bcb5a79d29481dab578c74c129f86ce
3
+ size 3023064672
olmoe-1b-7b-0924-q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dd99f24474fe3feda18c39c89c719754d5ed0cbe4016e9724101a0b05475e048
3
+ size 3928036960
olmoe-1b-7b-0924-q4_k_m.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f3ae25f6c7e83efb0e3632ef068b321f4d4a644bcfb6c0e01dd8c00e94e53f14
3
+ size 4213511776
olmoe-1b-7b-0924-q4_k_s.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fc0f32e4a57708e589f3cbc68798636e0ab69d9c89e02267df48a41d8241b1dc
3
+ size 3963688544
olmoe-1b-7b-0924-q5_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d8888c85c51459bdda9cb4d7079a780c142461b68944b25e50a348c8108e0c60
3
+ size 4779775584
olmoe-1b-7b-0924-q5_k_m.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e4e5652e7d3410dddd989cf85271b7d356207e9164b796f9685c443b4c7abe3f
3
+ size 4926838368
olmoe-1b-7b-0924-q5_k_s.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:979914cca2d49a598964e5cc0c8cfed218a346e9a60cf0374b86b8bbaefeb31c
3
+ size 4779775584
olmoe-1b-7b-0924-q6_k.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9c8b3ccb1a35b2d13b1b36552f0ce2f2a069ef90141c2392f64349e6ebbd3bbd
3
+ size 5684747872
olmoe-1b-7b-0924-q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f2049d5ac4a1c226bedb5b704dab0098d938199e7ddc052662e9159fab50e1b7
3
+ size 7359942240