Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

AutoTrain Compatible

Mixture of Experts

8-bit precision

Carbon Emissions

text-embeddings-inference

Models

17,752

Full-text search

Active filters: llama-cpp

openfree/Llama-3_3-Nemotron-Super-49B-v1-Q6_K-GGUF

Text Generation • Updated 14 days ago • 2.3k • 14

openfree/Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M-GGUF

Image-Text-to-Text • Updated 14 days ago • 2.14k • 12

openfree/Gemma-3-R1984-27B-Q8_0-GGUF

Image-Text-to-Text • Updated 14 days ago • 2.17k • 16

openfree/Gemma-3-R1984-27B-Q4_K_M-GGUF

Image-Text-to-Text • Updated 14 days ago • 1.83k • 15

openfree/Gemma-3-R1984-12B-Q6_K-GGUF

Image-Text-to-Text • Updated 14 days ago • 2.13k • 15

openfree/QwQ-32B-Q8_0-GGUF

Text Generation • Updated 14 days ago • 2.92k • 14

openfree/Qwen2.5-VL-32B-Instruct-Q8_0-GGUF

Image-Text-to-Text • Updated 14 days ago • 1.93k • 13

openfree/Gemma-3-R1984-27B-Q6_K-GGUF

Image-Text-to-Text • Updated 14 days ago • 1.6k • 11

openfree/Gemma-3-R1984-12B-Q8_0-GGUF

Image-Text-to-Text • Updated 14 days ago • 2.59k • 16

openfree/Mistral-Small-3.1-24B-Instruct-2503-Q8_0-GGUF

Image-Text-to-Text • Updated 14 days ago • 2.45k • 12

openfree/Mistral-Small-3.1-24B-Instruct-2503-Q6_K-GGUF

Image-Text-to-Text • Updated 14 days ago • 5.5k • 10

openfree/Llama-3_3-Nemotron-Super-49B-v1-Q4_K_M-GGUF

Text Generation • Updated 14 days ago • 2.49k • 10

openfree/Qwen2.5-VL-32B-Instruct-Q4_K_M-GGUF

Image-Text-to-Text • Updated 14 days ago • 3.71k • 13

openfree/QwQ-32B-Q4_K_M-GGUF

Text Generation • Updated 14 days ago • 2.5k • 10

openfree/QwQ-R1984-32B-Q8_0-GGUF

Updated 13 days ago • 305 • 12

openfree/QwQ-R1984-32B-Q4_K_M-GGUF

Updated 13 days ago • 2.24k • 15

NikolayKozloff/Llama-PLLuM-8B-instruct-Q8_0-GGUF

Updated Feb 24 • 95 • 4

NikolayKozloff/T-Rex-mini-Q8_0-GGUF

Updated 6 days ago • 326 • 4

isaiahbjork/orpheus-3b-0.1-ft-Q4_K_M-GGUF

Text-to-Speech • Updated 24 days ago • 13.4k • 44

matrixportal/Phi-3-mini-4k-instruct-Q4_K_M-GGUF

Text Generation • Updated Aug 18, 2024 • 65 • 3

lukasfast/Teuken-7B-instruct-research-v0.4-Q6_K-GGUF

Text Generation • Updated Jan 22 • 27 • 2

NikolayKozloff/Selene-1-Mini-Llama-3.1-8B-Q6_K-GGUF

Text Generation • Updated Jan 29 • 168 • 3

Karsh-CAI/Mistral-Small-24B-Instruct-2501-Q8_0-GGUF

Updated Jan 30 • 24 • 2

NikolayKozloff/DeepSeek-R1-ReDistill-Qwen-7B-v1.1-Q8_0-GGUF

Text Generation • Updated Jan 30 • 49 • 2

NikolayKozloff/DeepSeek-R1-Distill-Qwen-1.5B-Multilingual-Q8_0-GGUF

Updated Jan 31 • 202 • 2

smirki/UIGEN-T1.1-Qwen-7B-Q4_K_M-GGUF

Updated Feb 18 • 42 • 2

NikolayKozloff/PLLuM-12B-instruct-Q5_K_M-GGUF

Updated Feb 24 • 58 • 2

paultimothymooney/gemma-3-27b-it-Q4_K_M-GGUF

Image-Text-to-Text • Updated Mar 12 • 424 • 2

DreadPoor/Irix-12B-Model_Stock-GGUF

Updated 17 days ago • 791 • 2

Nasa1423/RolmOCR-Q4_K_M-GGUF

Updated 7 days ago • 276 • 2