Edit Models filters

Apps

Docker Model Runner

Inference Providers

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

97

Full-text search

Active filters: Q2_K

roleplaiapp/DeepSeek-R1-Distill-sthenno-14b-0121-Q2_K-GGUF

Text Generation • 15B • Updated Feb 2 • 6

roleplaiapp/DeepSeek-R1-Distill-Llama-3.1-16.5B-Brainstorm-i1-Q2_K-GGUF

Text Generation • 17B • Updated Feb 3 • 3

roleplaiapp/Crumb-13B-Q2_K-GGUF

Text Generation • 13B • Updated Feb 3 • 5

roleplaiapp/plato-9b-Q2_K-GGUF

Text Generation • 9B • Updated Feb 3 • 1

roleplaiapp/SJT-Moe2x7.5B-Q2_K-GGUF

Text Generation • 13B • Updated Feb 3 • 4

roleplaiapp/Llama3-Chinese-8B-Instruct-Q2_K-GGUF

Text Generation • 8B • Updated Feb 3 • 3

roleplaiapp/Apteed-LLM-Instruct-Q2_K-GGUF

Text Generation • 7B • Updated Feb 3 • 3