PsiPi
/

ehartford_dolphin-2.5-mixtral-8x7b-GGUF

Inference Endpoints

Model card Files Files and versions Community

Edit model card

YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/model-cards#model-card-metadata)

<|im_start|>system {system_message}<|im_end|> <|im_start|>user {prompt}<|im_end|> <|im_start|>assistant

Downloads last month: 17

GGUF

Model size

46.7B params

Architecture

llama

3-bit

Inference API

Unable to determine this model's library. Check the docs .

Collection including PsiPi/ehartford_dolphin-2.5-mixtral-8x7b-GGUF

24GB

Stuff sized to fit on 24GB rigs like the 3090 4090 etc with enough room for some context. • 2 items • Updated Dec 21, 2023