ExLlamaV2 Quants for the community
#1
by
bartowski
- opened
In case anyone comes here looking for a way to run locally, I made some ExLlamaV2 quants for this model here:
https://huggingface.co/bartowski/labradorite-13b-exl2