Hugging Face's logo

deepseek-ai
/
deepseek-coder-33b-instruct

Text Generation
Transformers
PyTorch
Safetensors
llama
conversational
text-generation-inference
Model card Files Community
32

quantized versions?

#2
by cameronbergh - opened
Discussion
cameronbergh

I am wondering if it will be possible to convert this to GGUF for inference?

supportend
•
edited Nov 4, 2023

Here: https://huggingface.co/TheBloke/deepseek-coder-33B-instruct-GGUF

I think, the files will be there soon.

Chester111 changed discussion status to closed
Your need to confirm your account before you can post a new comment.

Sign up or log in to comment