Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

AutoTrain Compatible

4-bit precision

Inference Endpoints

8-bit precision

Misc with no match

text-generation-inference

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

87

Full-text search

Active filters: granite-3.2

mlx-community/granite-3.2-8b-instruct-preview-8bit

Text Generation • Updated Feb 8 • 31

cgus/granite-3.2-8b-instruct-preview-exl2

Text Generation • Updated Feb 9 • 3

AaronFeng753/granite-3.2-8b-instruct-preview-Q8_0-GGUF

Text Generation • Updated Feb 9 • 1

LucyxDQ/granite-3.2-8b-instruct-preview-IQ4_NL-GGUF

Text Generation • Updated Feb 9 • 1

cgus/granite-3.2-8b-instruct-preview-iMat-GGUF

Text Generation • Updated Feb 9 • 44

Cran-May/granite-3.2-8b-instruct-preview-IQ4_NL-GGUF

Text Generation • Updated Feb 11 • 1

Mdubbya/granite-3.2-8b-instruct-preview-Q5_K_M-GGUF

Text Generation • Updated Feb 26 • 3

Mdubbya/granite-3.2-8b-instruct-preview-Q4_K_M-GGUF

Text Generation • Updated Feb 26 • 22

bartowski/ibm-granite_granite-3.2-8b-instruct-GGUF

Text Generation • Updated Feb 26 • 1.4k • 7

bartowski/ibm-granite_granite-3.2-2b-instruct-GGUF

Text Generation • Updated Feb 26 • 1.13k • 4

Mdubbya/granite-3.2-8b-instruct-preview-IQ4_NL-GGUF

Text Generation • Updated Feb 26 • 27

CISCai/granite-3.2-8b-instruct-SOTA-GGUF

Text Generation • Updated Feb 27 • 158

alexgusevski/granite-3.2-2b-instruct-q3-mlx

Text Generation • Updated Feb 26 • 13

alexgusevski/granite-3.2-2b-instruct-q6-mlx

Text Generation • Updated Feb 26 • 14

alexgusevski/granite-3.2-2b-instruct-q8-mlx

Text Generation • Updated Feb 26 • 20

cgus/granite-3.2-2b-instruct-exl2

Text Generation • Updated Feb 26 • 12

alexgusevski/granite-3.2-2b-instruct-mlx

Text Generation • Updated Feb 26 • 11

cgus/granite-3.2-8b-instruct-exl2

Text Generation • Updated Feb 27 • 8

lucyknada/ibm-granite_granite-3.2-8b-instruct-exl2

Text Generation • Updated Feb 27

zshannon/granite-3.2-2b-instruct-Q4-mlx

Text Generation • Updated Feb 27 • 17

BernTheCreator/Granite-3.2-8b-Instruct-Q4_0-GGUF

Text Generation • Updated Feb 28 • 24

EasierAI/Granite-3.2-2B

Text Generation • Updated Feb 28 • 123

EasierAI/Granite-3.2-8B

Text Generation • Updated Feb 28 • 179

msyukorai/granite-3.2-8b-instruct-preview-Q4_0-GGUF

Text Generation • Updated Feb 28 • 16

Triangle104/granite-3.2-8b-instruct-Q4_K_S-GGUF

Text Generation • Updated Feb 28 • 19

Triangle104/granite-3.2-8b-instruct-Q4_K_M-GGUF

Text Generation • Updated Feb 28 • 7

Triangle104/granite-3.2-8b-instruct-Q5_K_S-GGUF

Text Generation • Updated Feb 28 • 19

Triangle104/granite-3.2-8b-instruct-Q5_K_M-GGUF

Text Generation • Updated Feb 28 • 11

Triangle104/granite-3.2-8b-instruct-Q6_K-GGUF

Text Generation • Updated Feb 28 • 5

Triangle104/granite-3.2-8b-instruct-Q8_0-GGUF

Text Generation • Updated Feb 28 • 4