Under 10b iq4_nl gguf
Collection
Under 10B GGUFs Non-linear Quantized to try on 4GiB VRAM. Leaderboard https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard
•
43 items
•
Updated
•
3