Request for smaller quants
#1
by
BazsiBazsi
- opened
Excellent work for all the gemma quants! Would it be possible to make some experimental quants such as 2.75, 2.5, and 2.0 bpw versions?
Excellent work for all the gemma quants! Would it be possible to make some experimental quants such as 2.75, 2.5, and 2.0 bpw versions?
Here you go:
https://huggingface.co/MetaphoricalCode/gemma3-27b-abliterated-dpo-exl3-2bpw-hb6
https://huggingface.co/MetaphoricalCode/gemma3-27b-abliterated-dpo-exl3-2.5bpw-hb6