GGUF-Models
's Collections
✨Gemma
updated
Triangle104/GWQ-9B-Preview2-Q4_K_S-GGUF
Text Generation
•
Updated
•
8
Triangle104/GWQ-9B-Preview2-Q5_K_S-GGUF
Text Generation
•
Updated
•
8
Triangle104/GWQ-9B-Preview2-Q5_K_M-GGUF
Text Generation
•
Updated
•
8
•
1
Triangle104/GWQ-9B-Preview2-Q6_K-GGUF
Text Generation
•
Updated
•
5
Triangle104/GWQ-9B-Preview2-Q8_0-GGUF
Text Generation
•
Updated
•
7
matrixportal/gemma-2-2b-it-abliterated-Q8_0-GGUF
matrixportal/gemma-2-9b-it-Q4_0-GGUF
Text Generation
•
Updated
•
19
matrixportal/gemma-2-9b-it-tr-Q4_0-GGUF
Text Generation
•
Updated
•
5
matrixportal/gemma-2-2b-it-Q2_K-GGUF
Text Generation
•
Updated
•
4
matrixportal/gemma-2-9b-it-SimPO-Q2_K-GGUF
Updated
•
14
matrixportal/Gemmasutra-Mini-2B-v1-Q8_0-GGUF
Updated
•
31
•
1
matrixportal/wiroai-turkish-llm-9b-Q4_K_S-GGUF
Text Generation
•
Updated
•
16
matrixportal/wiroai-turkish-llm-9b-Q4_K_M-GGUF
Text Generation
•
Updated
•
18
•
2
matrixportal/gemma-2-2b-it-Q5_K_M-GGUF
Text Generation
•
Updated
•
13
matrixportal/gemma-2-9b-it-IQ3_XXS-GGUF
Text Generation
•
Updated
•
6
matrixportal/gemma-2-9b-it-Q2_K-GGUF
Text Generation
•
Updated
•
6
matrixportal/gemma-2-9b-it-SimPO-IQ4_NL-GGUF
Triangle104/GWQ2b-Q4_K_S-GGUF
Text Generation
•
Updated
•
5
Triangle104/GWQ2b-Q4_K_M-GGUF
Text Generation
•
Updated
•
4
Triangle104/GWQ2b-Q5_K_S-GGUF
Text Generation
•
Updated
•
6
Triangle104/GWQ2b-Q5_K_M-GGUF
Text Generation
•
Updated
•
3
Triangle104/GWQ2b-Q6_K-GGUF
Text Generation
•
Updated
•
5
Triangle104/GWQ2b-Q8_0-GGUF
Text Generation
•
Updated
•
4
Triangle104/FuseChat-Gemma-2-9B-Instruct-Q4_K_S-GGUF
Updated
•
18
Triangle104/FuseChat-Gemma-2-9B-Instruct-Q4_K_M-GGUF
Updated
•
20
Triangle104/FuseChat-Gemma-2-9B-Instruct-Q5_K_S-GGUF
Updated
•
24
Triangle104/FuseChat-Gemma-2-9B-Instruct-Q5_K_M-GGUF
Updated
•
30
Triangle104/FuseChat-Gemma-2-9B-Instruct-Q6_K-GGUF
Updated
•
15
Triangle104/FuseChat-Gemma-2-9B-Instruct-Q8_0-GGUF
Updated
•
15
itlwas/codegemma-2b-Q4_K_M-GGUF
Updated
•
26
itlwas/shieldgemma-2b-Q4_K_M-GGUF
Text Generation
•
Updated
•
6
itlwas/shieldgemma-9b-Q4_K_M-GGUF
Text Generation
•
Updated
•
6
itlwas/shieldgemma-27b-Q4_K_M-GGUF
Text Generation
•
Updated
•
9
itlwas/codegemma-7b-Q4_K_M-GGUF
Updated
•
29
itlwas/gemma-2-2b-it-Q4_K_M-GGUF
Text Generation
•
Updated
•
8
itlwas/Vikhr-Gemma-2B-instruct-Q4_K_M-GGUF
Updated
•
11
itlwas/gemma-2-9b-it-Q4_K_M-GGUF
Text Generation
•
Updated
•
5
itlwas/gemma-2-27b-it-Q4_K_M-GGUF
Text Generation
•
Updated
•
8
itlwas/gemma-2-9b-Q4_K_M-GGUF
Text Generation
•
Updated
•
5
itlwas/gemma-2-27b-Q4_K_M-GGUF
Text Generation
•
Updated
•
10
itlwas/dolphin-2.9.4-gemma2-2b-Q4_K_M-GGUF
Updated
•
8
•
1
itlwas/saiga_gemma2_9b-Q4_K_M-GGUF
itlwas/WoonaV1.2-9b-Q4_K_M-GGUF
itlwas/GWQ-9B-Preview-Q4_K_M-GGUF
Text Generation
•
Updated
•
4
itlwas/GWQ-9B-Preview2-Q4_K_M-GGUF
Text Generation
•
Updated
•
3
Triangle104/Rombo-LLM-V2.7-gemma-2-9b-Q4_K_S-GGUF
Triangle104/Rombo-LLM-V2.7-gemma-2-9b-Q4_K_M-GGUF
Triangle104/Rombo-LLM-V2.7-gemma-2-9b-Q5_K_M-GGUF
Triangle104/Rombo-LLM-V2.7-gemma-2-9b-Q6_K-GGUF
Triangle104/Rombo-LLM-V2.7-gemma-2-9b-Q8_0-GGUF
NikolayKozloff/Tiger-Gemma-9B-v1-Q4_0-GGUF
Updated
•
38
•
1
NikolayKozloff/BgGPT-Gemma-2-27B-IT-v1.0-Q2_K-GGUF
Text Generation
•
Updated
•
15
•
1
NikolayKozloff/gemma-2-27b-Q2_K-GGUF
Text Generation
•
Updated
•
6
•
1
NikolayKozloff/Vikhr-Gemma-2B-instruct-Q8_0-GGUF
Updated
•
16
•
2
NikolayKozloff/gemma-2-27b-Q3_K_S-GGUF
Text Generation
•
Updated
•
8
•
1
NikolayKozloff/Gemma-2-9B-It-SPPO-Iter3-IQ4_XS-GGUF
Text Generation
•
Updated
•
9
•
1
NikolayKozloff/gemma-2-9b-it-Q8_0-GGUF
Text Generation
•
Updated
•
5
•
1
NikolayKozloff/Hebrew-Gemma-11B-V2-Q6_K-GGUF
Updated
•
4
•
1
NikolayKozloff/Gemma-2-9B-It-SPPO-Iter3-IQ4_NL-GGUF
Text Generation
•
Updated
•
7
•
1
NikolayKozloff/Gemma-2-9B-It-SPPO-Iter3-Q4_0-GGUF
Text Generation
•
Updated
•
13
•
1
NikolayKozloff/gemma-2-9b-Q8_0-GGUF
Text Generation
•
Updated
•
18
•
1
NikolayKozloff/RoGemma-7b-Instruct-Q4_0-GGUF
Updated
•
9
•
1
NikolayKozloff/Gemma-2-9B-It-SPPO-Iter3-Q8_0-GGUF
Text Generation
•
Updated
•
5
•
2
NikolayKozloff/Gemma-2-9B-It-SPPO-Iter3-Q5_0-GGUF
Text Generation
•
Updated
•
6
•
1
NikolayKozloff/FuseChat-Gemma-2-9B-Instruct-Q8_0-GGUF
Updated
•
6
•
1
NikolayKozloff/gemma-portuguese-luana-2b-GGUF
Text Generation
•
Updated
•
23
•
2
NikolayKozloff/Gemma-2-9b-indic-Q8_0-GGUF
Updated
•
5
•
1
NikolayKozloff/gemma-2-2b-it-Q8_0-GGUF
Text Generation
•
Updated
•
6
•
1
NikolayKozloff/gemma-2-2b-jpn-it-Q8_0-GGUF
Text Generation
•
Updated
•
5
•
1
NikolayKozloff/BgGPT-Gemma-2-9B-IT-v1.0-Q8_0-GGUF
Text Generation
•
Updated
•
13
•
1
NikolayKozloff/gemma2-9B-sunfall-v0.5-Q8_0-GGUF
Text Generation
•
Updated
•
8
•
2
NikolayKozloff/RoGemma-7b-Instruct-Q5_K_L-GGUF
Updated
•
4
•
1
NikolayKozloff/gemma2-9B-daybreak-v0.5-Q8_0-GGUF
Updated
•
6
•
1
NikolayKozloff/Tiger-Gemma-9B-v1-Q8_0-GGUF
Updated
•
9
•
1
NikolayKozloff/BgGPT-Gemma-2-2.6B-IT-v1.0-Q8_0-GGUF
Text Generation
•
Updated
•
9
•
1
NikolayKozloff/Tiger-Gemma-9B-v1-Q5_0-GGUF
Updated
•
6
•
1
NikolayKozloff/SauerkrautLM-Gemma-2b-Q8_0-GGUF
Updated
•
5
•
1
NikolayKozloff/RoGemma-7b-Instruct-Q8_0-GGUF
Updated
•
5
•
1
NikolayKozloff/RoGemma-7b-Instruct-Q5_0-GGUF
Updated
•
6
•
1
NikolayKozloff/Gemma-2-9B-It-SPPO-Iter3-Q5_K_S-GGUF
Text Generation
•
Updated
•
8
•
1
NikolayKozloff/RoGemma-7b-Instruct-Q6_K_L-GGUF
Updated
•
6
•
1
NikolayKozloff/RoGemma-7b-Instruct-Q4_K_L-GGUF
Updated
•
4
•
1
NikolayKozloff/Tiger-Gemma-9B-v1-IQ4_NL-GGUF
Updated
•
6
•
1
NikolayKozloff/BgGPT-Gemma-2-2.6B-IT-v1.0-chatllm.cpp-int8-GGML
Triangle104/Gemma-2-2B-Smart-Q4_K_S-GGUF
Triangle104/Gemma-2-2B-Smart-Q4_K_M-GGUF
Triangle104/Gemma-2-2B-Smart-Q5_K_S-GGUF
Triangle104/Gemma-2-2B-Smart-Q5_K_M-GGUF
Triangle104/Gemma-2-2B-Smart-Q6_K-GGUF
Triangle104/Gemma-2-2B-Smart-Q8_0-GGUF
Triangle104/2B-ad-Q4_K_S-GGUF
Triangle104/2B-ad-Q4_K_M-GGUF
Triangle104/2B-ad-Q5_K_S-GGUF
Triangle104/2B-ad-Q5_K_M-GGUF
Triangle104/2B-ad-Q6_K-GGUF
Triangle104/2B-ad-Q8_0-GGUF
Triangle104/2B_or_not_2B-Q4_K_S-GGUF
Triangle104/2B_or_not_2B-Q4_K_M-GGUF
Triangle104/2B_or_not_2B-Q5_K_S-GGUF
Triangle104/2B_or_not_2B-Q5_K_M-GGUF
Triangle104/2B_or_not_2B-Q6_K-GGUF
Triangle104/2B_or_not_2B-Q8_0-GGUF
Triangle104/Gemmasutra-9B-v1.1-Q4_K_S-GGUF
Triangle104/Gemmasutra-9B-v1.1-Q4_K_M-GGUF
Triangle104/Gemmasutra-9B-v1.1-Q5_K_M-GGUF
Triangle104/Gemmasutra-9B-v1.1-Q6_K-GGUF
Triangle104/Gemmasutra-9B-v1.1-Q8_0-GGUF
Triangle104/Gemmasutra-Pro-27B-v1.1-Q4_K_S-GGUF
Triangle104/Gemmasutra-Pro-27B-v1.1-Q4_K_M-GGUF
Triangle104/Gemmasutra-Pro-27B-v1.1-Q3_K_S-GGUF
Triangle104/Gemmasutra-Pro-27B-v1.1-Q3_K_M-GGUF
Triangle104/Gemmasutra-Pro-27B-v1.1-Q3_K_L-GGUF
Triangle104/Gemmasutra-Pro-27B-v1.1-Q5_K_M-GGUF
Triangle104/Gemmasutra-Pro-27B-v1.1-Q6_K-GGUF
Triangle104/G2-9B-Aletheia-v1-Q4_K_S-GGUF
Updated
•
16
Triangle104/G2-9B-Aletheia-v1-Q4_K_M-GGUF
Updated
•
16
Triangle104/G2-9B-Aletheia-v1-Q5_K_S-GGUF
Updated
•
15
Triangle104/G2-9B-Aletheia-v1-Q5_K_M-GGUF
Updated
•
15
Triangle104/G2-9B-Aletheia-v1-Q6_K-GGUF
Updated
•
13
Triangle104/G2-9B-Aletheia-v1-Q8_0-GGUF
Updated
•
14
Triangle104/Gemma2-Gutenberg-Doppel-9B-Q4_K_S-GGUF
Updated
•
17
Triangle104/Gemma2-Gutenberg-Doppel-9B-Q4_K_M-GGUF
Updated
•
16
Triangle104/Gemma2-Gutenberg-Doppel-9B-Q5_K_S-GGUF
Updated
•
18
Triangle104/Gemma2-Gutenberg-Doppel-9B-Q5_K_M-GGUF
Updated
•
14
Triangle104/Gemma2-Gutenberg-Doppel-9B-Q6_K-GGUF
Updated
•
19
Triangle104/Gemma2-Gutenberg-Doppel-9B-Q8_0-GGUF
Updated
•
16
Triangle104/magnum-v4-9b-Q4_K_S-GGUF
Text Generation
•
Updated
•
6
•
1
Triangle104/magnum-v4-9b-Q4_K_M-GGUF
Text Generation
•
Updated
•
7
•
1
Triangle104/magnum-v4-9b-Q5_K_S-GGUF
Text Generation
•
Updated
•
8
•
1
Triangle104/magnum-v4-9b-Q5_K_M-GGUF
Text Generation
•
Updated
•
8
Triangle104/magnum-v4-9b-Q6_K-GGUF
Text Generation
•
Updated
•
6
Triangle104/magnum-v4-9b-Q8_0-GGUF
Text Generation
•
Updated
•
8
Triangle104/Gemmasutra-Pro-27B-v1.1-Q8_0-GGUF
Triangle104/Rombo-LLM-V2.7-gemma-2-27b-Q3_K_S-GGUF
Triangle104/Rombo-LLM-V2.7-gemma-2-27b-Q3_K_M-GGUF
Triangle104/Rombo-LLM-V2.7-gemma-2-27b-Q3_K_L-GGUF
Triangle104/Rombo-LLM-V2.7-gemma-2-27b-Q4_K_S-GGUF
Triangle104/Oni_Mitsubishi_12B-Q4_K_S-GGUF
Text2Text Generation
•
Updated
•
14
Triangle104/Oni_Mitsubishi_12B-Q4_K_M-GGUF
Text2Text Generation
•
Updated
•
34
Triangle104/Oni_Mitsubishi_12B-Q5_K_S-GGUF
Text2Text Generation
•
Updated
•
19
Triangle104/Oni_Mitsubishi_12B-Q5_K_M-GGUF
Text2Text Generation
•
Updated
•
16
Triangle104/Oni_Mitsubishi_12B-Q6_K-GGUF
Text2Text Generation
•
Updated
•
39
Triangle104/Oni_Mitsubishi_12B-Q8_0-GGUF
Text2Text Generation
•
Updated
•
40
Triangle104/gemma-3-1b-it-Q4_K_S-GGUF
Triangle104/gemma-3-1b-it-Q4_K_M-GGUF
Triangle104/gemma-3-1b-it-Q5_K_S-GGUF
Triangle104/gemma-3-1b-it-Q5_K_M-GGUF
Triangle104/gemma-3-1b-it-Q6_K-GGUF
Triangle104/gemma-3-1b-it-Q8_0-GGUF
Triangle104/gemma-3-4b-it-Q4_K_S-GGUF
Triangle104/gemma-3-4b-it-Q4_K_M-GGUF
Triangle104/gemma-3-4b-it-Q5_K_S-GGUF
Triangle104/gemma-3-4b-it-Q5_K_M-GGUF
Triangle104/gemma-3-4b-it-Q6_K-GGUF
Triangle104/gemma-3-4b-it-Q8_0-GGUF
Triangle104/gemma-3-12b-it-Q4_K_S-GGUF
Triangle104/gemma-3-12b-it-Q4_K_M-GGUF
Triangle104/gemma-3-12b-it-Q5_K_S-GGUF
Triangle104/gemma-3-12b-it-Q5_K_M-GGUF
Triangle104/gemma-3-12b-it-Q6_K-GGUF
Triangle104/gemma-3-12b-it-Q8_0-GGUF
Triangle104/gemma-3-27b-it-Q3_K_S-GGUF
Triangle104/gemma-3-27b-it-Q3_K_M-GGUF
Updated
•
33
Triangle104/gemma-3-27b-it-Q3_K_L-GGUF
Updated
•
7
Triangle104/gemma-3-27b-it-Q4_K_S-GGUF
Updated
•
45
Triangle104/gemma-3-27b-it-Q4_K_M-GGUF
Updated
•
33
Triangle104/gemma-3-27b-it-Q5_K_S-GGUF
Updated
•
50
Triangle104/gemma-3-27b-it-Q5_K_M-GGUF
Updated
•
43
Triangle104/gemma-3-27b-it-Q6_K-GGUF
Updated
•
40
Triangle104/gemma-3-27b-it-Q8_0-GGUF
Updated
•
44
Triangle104/Gemmasutra-Small-4B-v1-Q4_K_S-GGUF
Triangle104/Gemmasutra-Small-4B-v1-Q4_K_M-GGUF
Triangle104/Gemmasutra-Small-4B-v1-Q5_K_S-GGUF
Triangle104/Gemmasutra-Small-4B-v1-Q5_K_M-GGUF
Triangle104/Gemmasutra-Small-4B-v1-Q6_K-GGUF
Triangle104/Gemmasutra-Small-4B-v1-Q8_0-GGUF
Triangle104/gemma-3-12b-it-abliterated-Q4_K_S-GGUF
Image-Text-to-Text
•
Updated
•
366
Triangle104/gemma-3-12b-it-abliterated-Q4_K_M-GGUF
Image-Text-to-Text
•
Updated
•
264
Triangle104/gemma-3-12b-it-abliterated-Q5_K_S-GGUF
Image-Text-to-Text
•
Updated
•
90
Triangle104/gemma-3-12b-it-abliterated-Q5_K_M-GGUF
Image-Text-to-Text
•
Updated
•
79
Triangle104/gemma-3-12b-it-abliterated-Q6_K-GGUF
Image-Text-to-Text
•
Updated
•
87
Triangle104/gemma-3-12b-it-abliterated-Q8_0-GGUF
Image-Text-to-Text
•
Updated
•
226
Triangle104/Fallen-Gemma3-4B-v1-Q4_K_S-GGUF
Triangle104/Fallen-Gemma3-4B-v1-Q4_K_M-GGUF
Triangle104/Fallen-Gemma3-4B-v1-Q5_K_S-GGUF
Triangle104/Fallen-Gemma3-4B-v1-Q5_K_M-GGUF
Triangle104/Fallen-Gemma3-4B-v1-Q6_K-GGUF
Triangle104/Fallen-Gemma3-4B-v1-Q8_0-GGUF
Triangle104/Fallen-Gemma3-12B-v1-Q4_K_M-GGUF
Triangle104/Fallen-Gemma3-12B-v1-Q4_K_S-GGUF
Triangle104/Fallen-Gemma3-12B-v1-Q5_K_S-GGUF
Triangle104/Fallen-Gemma3-12B-v1-Q6_K-GGUF
Updated
•
148
Triangle104/Fallen-Gemma3-12B-v1-Q8_0-GGUF
Triangle104/Gemma-3-4b-it-Uncensored-DBL-X-Q4_K_S-GGUF
Text Generation
•
Updated
•
36
Triangle104/Gemma-3-4b-it-Uncensored-DBL-X-Q4_K_M-GGUF
Text Generation
•
Updated
•
93
Triangle104/Gemma-3-4b-it-Uncensored-DBL-X-Q5_K_S-GGUF
Text Generation
•
Updated
•
38
Triangle104/Gemma-3-4b-it-Uncensored-DBL-X-Q5_K_M-GGUF
Text Generation
•
Updated
•
40
Triangle104/Gemma-3-4b-it-Uncensored-DBL-X-Q6_K-GGUF
Text Generation
•
Updated
•
58
Triangle104/Gemma-3-4b-it-Uncensored-DBL-X-Q8_0-GGUF
Text Generation
•
Updated
•
170
Triangle104/X-Ray_Alpha-Q4_K_S-GGUF
Triangle104/X-Ray_Alpha-Q4_K_M-GGUF
Triangle104/X-Ray_Alpha-Q5_K_S-GGUF
Triangle104/X-Ray_Alpha-Q5_K_M-GGUF
Triangle104/X-Ray_Alpha-Q6_K-GGUF
Triangle104/X-Ray_Alpha-Q8_0-GGUF
Triangle104/gemma-3-4b-it-abliterated-Q4_K_S-GGUF
Image-Text-to-Text
•
Updated
•
30
Triangle104/gemma-3-4b-it-abliterated-Q4_K_M-GGUF
Image-Text-to-Text
•
Updated
•
27
Triangle104/gemma-3-4b-it-abliterated-Q5_K_S-GGUF
Image-Text-to-Text
•
Updated
•
41
Triangle104/gemma-3-4b-it-abliterated-Q5_K_M-GGUF
Image-Text-to-Text
•
Updated
•
37
Triangle104/gemma-3-4b-it-abliterated-Q6_K-GGUF
Image-Text-to-Text
•
Updated
•
23
Triangle104/gemma-3-4b-it-abliterated-Q8_0-GGUF
Image-Text-to-Text
•
Updated
•
18
Triangle104/GemmaCoder3-12B-Q4_K_S-GGUF
Updated
•
115
Triangle104/GemmaCoder3-12B-Q4_K_M-GGUF
Triangle104/GemmaCoder3-12B-Q5_K_S-GGUF
Triangle104/GemmaCoder3-12B-Q5_K_M-GGUF
Triangle104/GemmaCoder3-12B-Q6_K-GGUF
Updated
•
103
Triangle104/GemmaCoder3-12B-Q8_0-GGUF
Updated
•
115
itlwas/Gemma-3-R1984-12B-Q4_K_M-GGUF
Image-Text-to-Text
•
Updated
•
58
Triangle104/Gemma-3-4B-Toxic-R1-Q4_K_S-GGUF
Triangle104/Gemma-3-4B-Toxic-R1-Q4_K_M-GGUF
Triangle104/Gemma-3-4B-Toxic-R1-Q5_K_S-GGUF
Triangle104/Gemma-3-4B-Toxic-R1-Q5_K_M-GGUF
Triangle104/Gemma-3-4B-Toxic-R1-Q6_K-GGUF
Triangle104/Gemma-3-4B-Toxic-R1-Q8_0-GGUF
Triangle104/txgemma-9b-chat-Q4_K_S-GGUF
Text Generation
•
Updated
•
16
Triangle104/txgemma-9b-chat-Q4_K_M-GGUF
Text Generation
•
Updated
•
18
Triangle104/txgemma-9b-chat-Q5_K_S-GGUF
Text Generation
•
Updated
•
16
Triangle104/txgemma-9b-chat-Q5_K_M-GGUF
Text Generation
•
Updated
•
16
Triangle104/txgemma-9b-chat-Q6_K-GGUF
Text Generation
•
Updated
Triangle104/txgemma-9b-chat-Q8_0-GGUF
Text Generation
•
Updated
•
1