llama.cpp presets - a ggml-org Collection

ggml-org 's Collections

Multimodal GGUFs

VAD

InternVL 3 and InternVL 2.5

Qwen 2 VL and Qwen 2.5 VL

Qwen 3

Gemma 3

llama.cpp presets

GGUF LoRA adapters

Gemma 1.1 GGUFs

llama.cpp presets

updated May 14

Models that are used for presets in llama.cpp.

ggml-org/gte-small-Q8_0-GGUF

Sentence Similarity • 0.0B • Updated Feb 6 • 77 • 1
ggml-org/bge-small-en-v1.5-Q8_0-GGUF

Feature Extraction • 0.0B • Updated Feb 6 • 180 • 1
ggml-org/e5-small-v2-Q8_0-GGUF

Sentence Similarity • 0.0B • Updated Feb 6 • 51