Hugging Face's logo

CohereForAI
/
c4ai-command-r-v01-4bit

Text Generation
Transformers
Safetensors
cohere
conversational
custom_code
text-generation-inference
Inference Endpoints
4-bit precision
bitsandbytes
Model card Files Community
12

GGUF format for LM-Studio etc.

#1
by ahmetab06 - opened
Discussion
ahmetab06

Can u add to GGUF format for run it with LM-Studio

ahmetab06 changed discussion status to closed
ahmetab06 changed discussion status to open
flymonk

check this:

https://huggingface.co/andrewcanis/c4ai-command-r-v01-GGUF

blankreg

Unfortunately that's not the 4bit version

Sign up or log in to comment