allenai
/

OLMoE-1B-7B-0125-GGUF

Model card Files Files and versions Community

GGUF version of https://huggingface.co/allenai/OLMoE-1B-7B-0125

Downloads last month: 846

GGUF

Model size

6.92B params

Architecture

olmoe

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

16-bit

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for allenai/OLMoE-1B-7B-0125-GGUF

Base model

allenai/OLMoE-1B-7B-0125

Quantized

(6)

this model

Collection including allenai/OLMoE-1B-7B-0125-GGUF

OLMoE (January 2025)

Improved OLMoE for iOS app. Read more: https://allenai.org/blog/olmoe-app • 10 items • Updated 17 days ago • 12