Severian
/

Jamba-v0.1-Claude-Chat-GGUF

Model card Files Files and versions Community

Q6_K Version of the Jamba-Claude-Chat: https://huggingface.co/Norquinal/Jamba-v0.1-Claude-Chat

(Q8 and Q4_K_M in the works)

Can only be used with this fork until the merge is complete: https://github.com/ggerganov/llama.cpp/pull/7531

Downloads last month: 20

GGUF

Model size

51.6B params

Architecture

jamba

Hardware compatibility

Log In to view the estimation

6-bit

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Collection including Severian/Jamba-v0.1-Claude-Chat-GGUF

Jamba GGUF

Current GGUF's conversion of the Jamba models. Will be updated as support in llama.cpp merges/ https://github.com/ggerganov/llama.cpp/pull/7531 • 4 items • Updated May 30, 2024 • 2