Quantized versions please?
#13
by
eleius
- opened
Hello, I would appreciate if you uploaded GGUF quantized version if possible. Thanks in advance.
Hi,
I have quantized this model and will upload them here in GGUF format: https://huggingface.co/MaziyarPanahi/BioMedGPT-LM-7B-GGUF
@MaziyarPanahi Thank you so much. Would you mind also converting this other medical model to GGUF format? https://huggingface.co/AdaptLLM/medicine-chat
@eleius with pleasure! should be done here soon: https://huggingface.co/MaziyarPanahi/medicine-chat-GGUF
eleius
changed discussion status to
closed