ggml.ai

company

https://ggml.ai

ggml_org

ggml-org

Activity Feed

AI & ML interests

None defined yet.

Recent Activity

ngxson updated a model 1 day ago

ggml-org/LFM2-VL-450M-GGUF

ngxson published a model 1 day ago

ggml-org/LFM2-VL-450M-GGUF

ngxson new activity 2 days ago

ggml-org/gguf-my-lora:Fixing the error ModuleNotFoundError: No module named \'mistral_common\'\n

View all activity

Articles

Introduction to ggml

Aug 13, 2024

• 232

ggml-org 's collections 14

Gemma 3-270m

Collection of models for Gemma 3-270m

ggml-org/gemma-3-270m-GGUF

0.3B • Updated 5 days ago • 2.35k • 10
ggml-org/gemma-3-270m-it-GGUF

0.3B • Updated 4 days ago • 1.31k • 13
ggml-org/gemma-3-270m-qat-GGUF

0.3B • Updated 5 days ago • 445 • 6
ggml-org/gemma-3-270m-it-qat-GGUF

0.3B • Updated 4 days ago • 826 • 10

Gemma 3n

ggml-org/gemma-3n-E2B-it-GGUF

4B • Updated Jun 26 • 2.13k • 13
ggml-org/gemma-3n-E4B-it-GGUF

7B • Updated Jun 26 • 1.85k • 16

VAD

Voice Activity Detection (VAD) models for whisper.cpp.

ggml-org/whisper-vad

Updated May 13 • 5

Qwen 2 VL and Qwen 2.5 VL

ggml-org/Qwen2.5-VL-3B-Instruct-GGUF

3B • Updated Apr 30 • 4.42k • 5
ggml-org/Qwen2.5-VL-7B-Instruct-GGUF

8B • Updated Apr 30 • 2.57k • 7
ggml-org/Qwen2.5-VL-32B-Instruct-GGUF

33B • Updated May 15 • 694 • 3
ggml-org/Qwen2-VL-2B-Instruct-GGUF

2B • Updated Apr 30 • 891 • 2

SmolVLM GGUF

ggml-org/SmolVLM2-2.2B-Instruct-GGUF

2B • Updated Apr 30 • 5k • 18
ggml-org/SmolVLM2-500M-Video-Instruct-GGUF

0.4B • Updated Apr 30 • 1.99k • 11
ggml-org/SmolVLM2-256M-Video-Instruct-GGUF

0.2B • Updated Apr 30 • 525 • 6
ggml-org/SmolVLM-Instruct-GGUF

2B • Updated Apr 30 • 605 • 7

llama.cpp presets

Models that are used for presets in llama.cpp.

ggml-org/gte-small-Q8_0-GGUF

Sentence Similarity • 0.0B • Updated Feb 6 • 58 • 1
ggml-org/bge-small-en-v1.5-Q8_0-GGUF

Feature Extraction • 0.0B • Updated Feb 6 • 139 • 2
ggml-org/e5-small-v2-Q8_0-GGUF

Sentence Similarity • 0.0B • Updated Feb 6 • 15

llama.vim

ggml-org/Qwen2.5-Coder-0.5B-Q8_0-GGUF

Text Generation • 0.5B • Updated Jan 31 • 12.7k • 6
ggml-org/Qwen2.5-Coder-1.5B-Q8_0-GGUF

Text Generation • 2B • Updated Oct 28, 2024 • 5.15k • 9
ggml-org/Qwen2.5-Coder-3B-Q8_0-GGUF

Text Generation • 3B • Updated Nov 26, 2024 • 1.64k • 5
ggml-org/Qwen2.5-Coder-7B-Q8_0-GGUF

Text Generation • 8B • Updated Oct 28, 2024 • 2.11k • 5

GPT OSS

ggml-org/gpt-oss-120b-GGUF

117B • Updated 9 days ago • 18.3k • 20
ggml-org/gpt-oss-20b-GGUF

21B • Updated 9 days ago • 61.8k • 63

Multimodal GGUFs

Vision and audio models compatible with llama-server and llama-mtmd-cli

Gemma 3

Collection

4 items • Updated May 14 • 17
ggml-org/Mistral-Small-3.1-24B-Instruct-2503-GGUF

Image-Text-to-Text • 24B • Updated May 1 • 367 • 4
InternVL 3 and InternVL 2.5

Collection

10 items • Updated May 14
Qwen 2 VL and Qwen 2.5 VL

Collection

4 items • Updated May 14

InternVL 3 and InternVL 2.5

ggml-org/InternVL3-1B-Instruct-GGUF

0.6B • Updated May 10 • 706 • 3
ggml-org/InternVL3-2B-Instruct-GGUF

2B • Updated May 10 • 655 • 5
ggml-org/InternVL3-8B-Instruct-GGUF

8B • Updated May 10 • 808 • 5
ggml-org/InternVL3-14B-Instruct-GGUF

15B • Updated May 10 • 525 • 3

Qwen 3

ggml-org/Qwen3-0.6B-GGUF

0.8B • Updated Apr 28 • 858 • 5
ggml-org/Qwen3-1.7B-GGUF

2B • Updated Apr 28 • 1.24k • 2
ggml-org/Qwen3-4B-GGUF

4B • Updated Apr 28 • 501 • 1
ggml-org/Qwen3-8B-GGUF

8B • Updated Apr 28 • 431 • 3

Gemma 3

ggml-org/gemma-3-1b-it-GGUF

1.0B • Updated Mar 12 • 11.2k • 18
ggml-org/gemma-3-4b-it-GGUF

Image-Text-to-Text • 4B • Updated May 21 • 14.1k • 37
ggml-org/gemma-3-12b-it-GGUF

Image-Text-to-Text • 12B • Updated May 21 • 2.6k • 27
ggml-org/gemma-3-27b-it-GGUF

Image-Text-to-Text • 27B • Updated May 21 • 1.66k • 21

GGUF LoRA adapters

Adapters extracted from fine tuned models, using mergekit-extract-lora

ggml-org/LoRA-Llama-3-Instruct-abliteration-8B-F16-GGUF

0.1B • Updated Nov 1, 2024 • 12
ggml-org/LoRA-Qwen2.5-1.5B-Instruct-abliterated-F16-GGUF

0.1B • Updated Jan 23 • 23 • 2
ggml-org/LoRA-Qwen2.5-3B-Instruct-abliterated-F16-GGUF

0.1B • Updated Jan 9 • 12 • 1
ggml-org/LoRA-Qwen2.5-7B-Instruct-abliterated-v3-F16-GGUF

0.1B • Updated Jan 8 • 29 • 3

Gemma 1.1 GGUFs

ggml-org/gemma-1.1-2b-it-Q8_0-GGUF

3B • Updated Apr 5, 2024 • 1.14k • 1
ggml-org/gemma-1.1-7b-it-Q8_0-GGUF

9B • Updated Apr 5, 2024 • 20
ggml-org/gemma-1.1-7b-it-Q4_K_M-GGUF

9B • Updated Apr 5, 2024 • 1.07k • 4

Gemma 3-270m

Collection of models for Gemma 3-270m

ggml-org/gemma-3-270m-GGUF

0.3B • Updated 5 days ago • 2.35k • 10
ggml-org/gemma-3-270m-it-GGUF

0.3B • Updated 4 days ago • 1.31k • 13
ggml-org/gemma-3-270m-qat-GGUF

0.3B • Updated 5 days ago • 445 • 6
ggml-org/gemma-3-270m-it-qat-GGUF

0.3B • Updated 4 days ago • 826 • 10

GPT OSS

ggml-org/gpt-oss-120b-GGUF

117B • Updated 9 days ago • 18.3k • 20
ggml-org/gpt-oss-20b-GGUF

21B • Updated 9 days ago • 61.8k • 63

Gemma 3n

ggml-org/gemma-3n-E2B-it-GGUF

4B • Updated Jun 26 • 2.13k • 13
ggml-org/gemma-3n-E4B-it-GGUF

7B • Updated Jun 26 • 1.85k • 16

Multimodal GGUFs

Vision and audio models compatible with llama-server and llama-mtmd-cli

Gemma 3

Collection

4 items • Updated May 14 • 17
ggml-org/Mistral-Small-3.1-24B-Instruct-2503-GGUF

Image-Text-to-Text • 24B • Updated May 1 • 367 • 4
InternVL 3 and InternVL 2.5

Collection

10 items • Updated May 14
Qwen 2 VL and Qwen 2.5 VL

Collection

4 items • Updated May 14

VAD

Voice Activity Detection (VAD) models for whisper.cpp.

ggml-org/whisper-vad

Updated May 13 • 5

InternVL 3 and InternVL 2.5

ggml-org/InternVL3-1B-Instruct-GGUF

0.6B • Updated May 10 • 706 • 3
ggml-org/InternVL3-2B-Instruct-GGUF

2B • Updated May 10 • 655 • 5
ggml-org/InternVL3-8B-Instruct-GGUF

8B • Updated May 10 • 808 • 5
ggml-org/InternVL3-14B-Instruct-GGUF

15B • Updated May 10 • 525 • 3

Qwen 2 VL and Qwen 2.5 VL

ggml-org/Qwen2.5-VL-3B-Instruct-GGUF

3B • Updated Apr 30 • 4.42k • 5
ggml-org/Qwen2.5-VL-7B-Instruct-GGUF

8B • Updated Apr 30 • 2.57k • 7
ggml-org/Qwen2.5-VL-32B-Instruct-GGUF

33B • Updated May 15 • 694 • 3
ggml-org/Qwen2-VL-2B-Instruct-GGUF

2B • Updated Apr 30 • 891 • 2

Qwen 3

ggml-org/Qwen3-0.6B-GGUF

0.8B • Updated Apr 28 • 858 • 5
ggml-org/Qwen3-1.7B-GGUF

2B • Updated Apr 28 • 1.24k • 2
ggml-org/Qwen3-4B-GGUF

4B • Updated Apr 28 • 501 • 1
ggml-org/Qwen3-8B-GGUF

8B • Updated Apr 28 • 431 • 3

SmolVLM GGUF

ggml-org/SmolVLM2-2.2B-Instruct-GGUF

2B • Updated Apr 30 • 5k • 18
ggml-org/SmolVLM2-500M-Video-Instruct-GGUF

0.4B • Updated Apr 30 • 1.99k • 11
ggml-org/SmolVLM2-256M-Video-Instruct-GGUF

0.2B • Updated Apr 30 • 525 • 6
ggml-org/SmolVLM-Instruct-GGUF

2B • Updated Apr 30 • 605 • 7

Gemma 3

ggml-org/gemma-3-1b-it-GGUF

1.0B • Updated Mar 12 • 11.2k • 18
ggml-org/gemma-3-4b-it-GGUF

Image-Text-to-Text • 4B • Updated May 21 • 14.1k • 37
ggml-org/gemma-3-12b-it-GGUF

Image-Text-to-Text • 12B • Updated May 21 • 2.6k • 27
ggml-org/gemma-3-27b-it-GGUF

Image-Text-to-Text • 27B • Updated May 21 • 1.66k • 21

llama.cpp presets

Models that are used for presets in llama.cpp.

ggml-org/gte-small-Q8_0-GGUF

Sentence Similarity • 0.0B • Updated Feb 6 • 58 • 1
ggml-org/bge-small-en-v1.5-Q8_0-GGUF

Feature Extraction • 0.0B • Updated Feb 6 • 139 • 2
ggml-org/e5-small-v2-Q8_0-GGUF

Sentence Similarity • 0.0B • Updated Feb 6 • 15

GGUF LoRA adapters

Adapters extracted from fine tuned models, using mergekit-extract-lora

ggml-org/LoRA-Llama-3-Instruct-abliteration-8B-F16-GGUF

0.1B • Updated Nov 1, 2024 • 12
ggml-org/LoRA-Qwen2.5-1.5B-Instruct-abliterated-F16-GGUF

0.1B • Updated Jan 23 • 23 • 2
ggml-org/LoRA-Qwen2.5-3B-Instruct-abliterated-F16-GGUF

0.1B • Updated Jan 9 • 12 • 1
ggml-org/LoRA-Qwen2.5-7B-Instruct-abliterated-v3-F16-GGUF

0.1B • Updated Jan 8 • 29 • 3

llama.vim

ggml-org/Qwen2.5-Coder-0.5B-Q8_0-GGUF

Text Generation • 0.5B • Updated Jan 31 • 12.7k • 6
ggml-org/Qwen2.5-Coder-1.5B-Q8_0-GGUF

Text Generation • 2B • Updated Oct 28, 2024 • 5.15k • 9
ggml-org/Qwen2.5-Coder-3B-Q8_0-GGUF

Text Generation • 3B • Updated Nov 26, 2024 • 1.64k • 5
ggml-org/Qwen2.5-Coder-7B-Q8_0-GGUF

Text Generation • 8B • Updated Oct 28, 2024 • 2.11k • 5

Gemma 1.1 GGUFs

ggml-org/gemma-1.1-2b-it-Q8_0-GGUF

3B • Updated Apr 5, 2024 • 1.14k • 1
ggml-org/gemma-1.1-7b-it-Q8_0-GGUF

9B • Updated Apr 5, 2024 • 20
ggml-org/gemma-1.1-7b-it-Q4_K_M-GGUF

9B • Updated Apr 5, 2024 • 1.07k • 4

AI & ML interests

Recent Activity

Articles

Introduction to ggml

Team members 11

ggml-org 's collections 14