Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

34,942

Full-text search

Active filters: 4-bit

mlx-community/Josiefied-Qwen3-4B-abliterated-v1-4bit

Text Generation • Updated May 1 • 567 • 2

Qwen/Qwen3-30B-A3B-GPTQ-Int4

Text Generation • Updated 19 days ago • 67.8k • 14

Jh0mpis/gemma-3-4b-physics-instruct-alpaca-model

Updated May 6 • 6 • 1

Qwen/Qwen3-235B-A22B-GPTQ-Int4

Text Generation • Updated 19 days ago • 7.77k • 14

huihui-ai/Qwen3-14B-abliterated-fp4

Text Generation • Updated 29 days ago • 43 • 1

mlx-community/gemma-3-27b-it-4bit-DWQ

Text Generation • Updated 25 days ago • 808 • 2

lmstudio-community/Devstral-Small-2505-MLX-4bit

Text Generation • Updated 20 days ago • 213k • 4

unsloth/medgemma-4b-it-unsloth-bnb-4bit

Image-Text-to-Text • Updated 19 days ago • 7.25k • 1

unsloth/Devstral-Small-2505-unsloth-bnb-4bit

Text2Text Generation • Updated 15 days ago • 2.17k • 4

unsloth/Devstral-Small-2505-bnb-4bit

Text2Text Generation • Updated 15 days ago • 2.09k • 3

mlx-community/Devstral-Small-2505-4bit-DWQ

Text Generation • Updated 18 days ago • 844 • 4

NeoChen1024/llama-joycaption-beta-one-hf-llava-GPTQ-4bit-sym-autoround

Updated 13 days ago • 70 • 3

Jimmi42/sarvam-m-4bit-mlx

Text Generation • Updated 14 days ago • 30 • 1

mlx-community/DeepSeek-R1-0528-4bit

Text Generation • Updated 11 days ago • 2.41k • 10

lmstudio-community/DeepSeek-R1-0528-Qwen3-8B-MLX-4bit

Text Generation • Updated 10 days ago • 383k • 1

unsloth/DeepSeek-R1-0528-Qwen3-8B-bnb-4bit

Text Generation • Updated 30 minutes ago • 9.08k • 3

MaziyarPanahi/DeepSeek-R1-0528-Qwen3-8B-GGUF

Text Generation • Updated 10 days ago • 65.9k • 3

hxac/DeepSeek-R1-0528-Qwen3-8B-AWQ-4bit

Text Generation • Updated 9 days ago • 489 • 3

sid22669/Llama-3.2-1b-instruct-bnb-4bit

Text Generation • Updated 9 days ago • 90 • 1

QuantTrio/DeepSeek-R1-0528-GPTQ-Int4-Int8Mix-Lite

Text Generation • Updated 5 days ago • 90 • 1

Intel/DeepSeek-R1-0528-Qwen3-8B-int4-AutoRound-awq-inc

Updated 8 days ago • 949 • 1

MetaphoricalCode/Synthia-S1-27b-exl3-4bpw-hb6

Image-Text-to-Text • Updated 8 days ago • 27 • 1

QuantTrio/DeepSeek-R1-0528-GPTQ-Int4-Int8Mix-Compact

Text Generation • Updated 5 days ago • 446 • 1

ziyingchen1106/Llama-3.2-3B-Instruct-fp16-lora-gptqmodel-4bit

Text Generation • Updated 7 days ago • 28 • 1

mlx-community/Qwen3-4B-4bit-DWQ-053125

Text Generation • Updated 7 days ago • 495 • 1

mlx-community/Qwen3-8B-4bit-DWQ-053125

Text Generation • Updated 7 days ago • 215 • 1

mlx-community/Qwen3-14B-4bit-DWQ-053125

Text Generation • Updated 7 days ago • 205 • 1

xwzagan/Qwen3-14b-windmaster-4bit

Updated 6 days ago • 38 • 1

c1uc/Llama-3.2-3B-Instruct-lora-4bit-g128

Updated 6 days ago • 434 • 1

QuantTrio/DeepSeek-R1-0528-GPTQ-Int4-Int8Mix-Medium

Text Generation • Updated 4 days ago • 528 • 1