exl2 version
#1
by
Apel-sin
- opened
https://huggingface.co/Apel-sin/llama-3-8B-ortho-by-edgerunners-v5_exl2_6.5bpw
https://huggingface.co/Apel-sin/llama-3-8B-ortho-by-edgerunners-v5_exl2_8.0bpw
Gold bpw standard from bartowski :)
I want to support your project a little bit