Quantized GGUF models
#1
by
bullerwins
- opened
Hi!
If anyone wants to use the GGUF quantized version to use with llama.cpp I have uploaded them here:
https://huggingface.co/bullerwins/Athene-70B-GGUF