Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

AutoTrain Compatible

4-bit precision

Inference Endpoints

8-bit precision

Misc with no match

text-generation-inference

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

87

Full-text search

Active filters: granite-3.2

Triangle104/granite-3.2-2b-instruct-Q4_K_S-GGUF

Text Generation • Updated Feb 28 • 20

Triangle104/granite-3.2-2b-instruct-Q4_K_M-GGUF

Text Generation • Updated Feb 28 • 6

Triangle104/granite-3.2-2b-instruct-Q5_K_S-GGUF

Text Generation • Updated Feb 28 • 20

Triangle104/granite-3.2-2b-instruct-Q5_K_M-GGUF

Text Generation • Updated Feb 28 • 12

Triangle104/granite-3.2-2b-instruct-Q6_K-GGUF

Text Generation • Updated Feb 28 • 19

Triangle104/granite-3.2-2b-instruct-Q8_0-GGUF

Text Generation • Updated Feb 28 • 6

ObeJ/granite-3.2-8b-instruct-Q8_0-GGUF

Text Generation • Updated Mar 3 • 2

unsloth/granite-3.2-8b-instruct-unsloth-bnb-4bit

Text Generation • Updated Mar 5 • 536

tensorblock/granite-3.2-8b-instruct-preview-GGUF

Text Generation • Updated Mar 6 • 165

Triangle104/granite-3.2-2b-instruct-abliterated-Q4_K_S-GGUF

Text Generation • Updated Mar 8 • 2

bchen-snp/granite-3.2-8b-instruct-Q4_K_M-GGUF

Text Generation • Updated Mar 9 • 2

cgus/granite-3.2-8b-instruct-abliterated-exl2

Text Generation • Updated Mar 10 • 3

Triangle104/granite-3.2-2b-instruct-abliterated-Q4_K_M-GGUF

Text Generation • Updated Mar 11 • 8

Triangle104/granite-3.2-2b-instruct-abliterated-Q5_K_S-GGUF

Text Generation • Updated Mar 11 • 2

Triangle104/granite-3.2-2b-instruct-abliterated-Q5_K_M-GGUF

Text Generation • Updated Mar 11 • 2

Triangle104/granite-3.2-2b-instruct-abliterated-Q6_K-GGUF

Text Generation • Updated Mar 11 • 4

Triangle104/granite-3.2-2b-instruct-abliterated-Q8_0-GGUF

Text Generation • Updated Mar 11 • 5

cobrakenji/granite-3.2-8b-instruct-Q4_K_M-GGUF

Text Generation • Updated 28 days ago • 5

Mungert/granite-3.2-8b-instruct-GGUF

Text Generation • Updated 12 days ago • 1.4k • 3

ibm-research/granite-guardian-3.2-3b-a800m-GGUF

Text Generation • Updated 18 days ago • 243

ibm-research/granite-guardian-3.2-5b-GGUF

Text Generation • Updated 18 days ago • 286

spacematt/granite-3.2-8b-instruct-Q6_K-GGUF

Text Generation • Updated 25 days ago • 28

tensorblock/granite-3.2-2b-instruct-GGUF

Text Generation • Updated 24 days ago • 268

TiananZ/granite-3.2-2b-instruct-Q8_0-GGUF

Text Generation • Updated 24 days ago • 8

Mozilla/granite-3.2-8b-instruct-llamafile

Text Generation • Updated 15 days ago • 78

Mozilla/granite-3.2-2b-instruct-llamafile

Text Generation • Updated 15 days ago • 60

fedora-copr/granite-3.2-8b-instruct-GGUF

Text Generation • Updated 6 days ago • 19