Under 10b iq4_nl gguf - a hellork Collection

hellork 's Collections

text-to-image <=8B gguf

LLAVA Vision Models

Under 10b iq4_xs gguf

Under 10b iq4_nl gguf

Under 10b iq4_nl gguf

updated Feb 9

Under 10B GGUFs Non-linear Quantized to try on 4GiB VRAM. Leaderboard https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard

hellork/Qwen2-7B-Instruct-IQ4_NL-GGUF

Text Generation • Updated Sep 17, 2024 • 4
SixOpen/Nous-Capybara-7B-V1.9-IQ4_NL-GGUF

Updated May 31, 2024 • 8
SixOpen/Phi-3-mini-4k-instruct-IQ4_NL-imat.gguf

Text Generation • Updated May 22, 2024 • 26
n3shelter/Peach-9B-8k-Roleplay-IQ4_XS-GGUF

Text Generation • Updated Aug 11, 2024 • 3 • 1
aifeifei798/llama3-8B-DarkIdol-2.0-Uncensored-IQ4_NL-GGUF

Updated Jul 1, 2024 • 11 • 1
Trisert/Meta-Llama-3.1-8B-Instruct-IQ4_NL-GGUF

Text Generation • Updated Aug 18, 2024 • 18 • 1
Jianping746/Llama3.1-8B-Chinese-Chat-IQ4_XS-GGUF

Text Generation • Updated Jul 27, 2024 • 10
DarqueDante/Llama-3.1-8B-Stheno-v3.4-IQ4_XS-GGUF

Updated Aug 19, 2024 • 4
herrkobold/SauerkrautLM-1.5b-IQ4_XS-GGUF

Updated Jul 24, 2024 • 31
GrimsenClory/Meta-Llama-3.1-8B-Instruct-IQ4_XS-GGUF

Text Generation • Updated Jul 26, 2024 • 38
Niansuh/Llama-3-Groq-8B-Tool-Use-IQ4_NL-GGUF

Updated Jul 23, 2024 • 27
Cran-May/openbuddy-llama3.1-8b-v22.3-131k-IQ4_XS-GGUF

Text Generation • Updated Aug 18, 2024 • 1
matrixportal/Meta-Llama-3.1-8B-Instruct-IQ4_NL-GGUF

Text Generation • Updated Aug 2, 2024 • 29
askmyteapot/Meta-Llama-3-70B-Instruct-abliterated-v3.5-IQ4_XS

Updated Jun 3, 2024 • 33
Amensia/Qwen2-1.5B-Instruct-IQ4_NL-GGUF

Text Generation • Updated Aug 7, 2024 • 3
float-trip/drama-llama-3-iq4_xs

Updated Apr 27, 2024 • 2
NikolayKozloff/Dorna-Llama3-8B-Instruct-IQ4_XS-GGUF

Updated Jun 12, 2024 • 33 • 1
Cran-May/Gemma-2-9B-Chinese-Chat-IQ4_XS-GGUF

Text Generation • Updated Jul 2, 2024 • 30
SixOpen/Meta-Llama-3-8B-Instruct-IQ4_NL-GGUF

Text Generation • Updated Jun 11, 2024 • 32
NikolayKozloff/Dorna-Llama3-8B-Instruct-IQ4_NL-GGUF

Updated Jun 12, 2024 • 35 • 1
gate369/Phi-3-mini-128k-instruct-IQ4_XS-GGUF

Text Generation • Updated Jun 12, 2024 • 9
Alex01837178373/gemma-2-9b-it-abliterated-IQ4_NL-GGUF

Updated Jul 15, 2024 • 12
lucasdozie/gemma-2-2b-it-IQ4_NL-GGUF

Text Generation • Updated Aug 14, 2024 • 6
hanchungshin/Meta-Llama-3.1-8B-Instruct-IQ4_NL-GGUF

Text Generation • Updated Aug 7, 2024 • 26
ElMater06/Mistral-7B-Instruct-v0.3-IQ4_NL-GGUF

Updated Jun 19, 2024 • 31 • 1
NikolayKozloff/L3-8B-Lunaris-v1-IQ4_NL-GGUF

Updated Jun 28, 2024 • 10 • 1
NikolayKozloff/Llama-3-Instruct-Neurona-8b-v2-IQ4_NL-GGUF

Text Generation • Updated Jul 2, 2024 • 36 • 1
NikolayKozloff/llama3-turbcat-instruct-8b-IQ4_NL-GGUF

Updated Jun 21, 2024 • 22 • 1
NikolayKozloff/tabula-8b-IQ4_NL-GGUF

Updated Jun 23, 2024 • 5 • 1
qnixsynapse/Meta-Llama-3-8B-Instruct-IQ4_XS-GGUF

Text Generation • Updated Jul 12, 2024 • 78
qnixsynapse/gemma-2-9b-it-IQ4_XS-GGUF

Text Generation • Updated Jul 16, 2024 • 6
Joseph717171/Llama-3.1-SuperNova-Lite-8.0B-OQ8_0-F32.EF32.IQ4_K-Q8_0-GGUF

Updated Jan 21 • 343 • 2
DarwinAnim8or/mergekit-model_stock-ffibbcs-IQ4_NL-GGUF

Updated Aug 26, 2024 • 18 • 1
bunnycore/Llama-3.1-8B-OmniMatrix-IQ4_NL-GGUF

Updated Sep 13, 2024 • 23 • 1
bunnycore/HyperLlama-3.1-8B-IQ4_NL-GGUF

Updated Sep 4, 2024 • 6 • 1
DarwinAnim8or/mergekit-model_stock-ffibbcs-IQ4_XS-GGUF

Updated Aug 28, 2024 • 28 • 1
sehiro/EvoLLM-JP-A-v1-7B-IQ4_XS-GGUF

Updated Sep 15, 2024 • 11 • 1
Joseph717171/Gemma-2-2b-it-OQ8_0-F32.EF32.IQ4_K_M-8_0-GGUF

Updated Sep 23, 2024 • 101 • 1
utterlygreat/omost-dolphin-2.9-llama3-8b-IQ4_XS-GGUF

Updated Jul 10, 2024 • 17
bunnycore/Crazy-Qwen2-7b-IQ4_NL-GGUF

Updated Sep 1, 2024 • 6
mradermacher/FinMatcha-3B-Instruct-i1-GGUF

Updated 1 day ago • 77
tiiuae/Falcon3-7B-Instruct

Text Generation • Updated 13 days ago • 56.2k • 66