Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

34,645

Full-text search

Active filters: 4-bit

unsloth/Qwen2.5-VL-7B-Instruct-unsloth-bnb-4bit

Image-Text-to-Text • Updated 24 days ago • 101k • 32

unsloth/Meta-Llama-3.1-8B-Instruct-unsloth-bnb-4bit

Text Generation • Updated Feb 15 • 72.1k • 3

ahaduzzamanasif/CADLlama

Text Generation • Updated Feb 3 • 126 • 1

nguyen599/deepseek-qwen-14b-aime-awq

Updated Feb 17 • 1

Qwen/QwQ-32B-AWQ

Text Generation • Updated Mar 11 • 19.3k • 125

LGAI-EXAONE/EXAONE-Deep-7.8B-AWQ

Text Generation • Updated Mar 19 • 203 • 14

unsloth/gemma-3-27b-it-unsloth-bnb-4bit

Image-Text-to-Text • Updated 24 days ago • 23.7k • 17

unsloth/gemma-3-12b-it-unsloth-bnb-4bit

Image-Text-to-Text • Updated 24 days ago • 41.8k • 13

mlx-community/gemma-3-text-4b-pt-4bit

Text Generation • Updated Mar 18 • 49 • 1

gaunernst/gemma-3-12b-it-int4-awq

Image-Text-to-Text • Updated Apr 6 • 6.68k • 11

gaunernst/gemma-3-27b-it-int4-awq

Image-Text-to-Text • Updated Apr 6 • 5.83k • 21

MaziyarPanahi/ReasonFlux-F1-14B-GGUF

Text Generation • Updated Mar 24 • 34 • 1

RichardErkhov/thrishala_-_mental_health_chatbot-4bits

Updated Mar 24 • 1

AIDC-AI/Ovis2-4B-GPTQ-Int4

Image-Text-to-Text • Updated Mar 25 • 674 • 3

hjc4869/Llama-3.3-70B-Instruct-w4g32-auto-gptq

Updated Mar 28 • 9 • 1

gaunernst/gemma-3-4b-it-qat-autoawq

Image-Text-to-Text • Updated Apr 6 • 541 • 1

mbley/google-gemma-2-27b-it-AWQ

Text Generation • Updated Apr 25 • 145 • 2

kishizaki-sci/Llama-4-Scout-17B-16E-Instruct-AWQ

Updated May 4 • 11.1k • 3

wolfofbackstreet/DeepCoder-14B-Preview-int4-qptq-v1

Text Generation • Updated Apr 23 • 24 • 1

unsloth/Qwen3-4B-unsloth-bnb-4bit

Text Generation • Updated 23 days ago • 86k • 6

unsloth/Qwen3-8B-bnb-4bit

Updated 23 days ago • 12k • 1

lmstudio-community/Qwen3-32B-MLX-4bit

Text Generation • Updated Apr 28 • 39.5k • 3

lmstudio-community/Qwen3-30B-A3B-MLX-4bit

Text Generation • Updated 8 days ago • 32.8k • 22

abhishekchohan/Qwen3-32B-AWQ

Updated Apr 30 • 730 • 1

Qwen/Qwen3-14B-AWQ

Text Generation • Updated 15 days ago • 46.2k • 23

kaitchup/Qwen3-14B-autoround-4bit-gptq

Updated May 2 • 434 • 1

Jh0mpis/gemma-3-4b-physics-instruct-alpaca-model

Updated 30 days ago • 28 • 1

ericrisco/llama3-1-1b-instruct-tune-500s

Text Generation • Updated 22 days ago • 11 • 1

Qwen/Qwen3-235B-A22B-GPTQ-Int4

Text Generation • Updated 15 days ago • 6.52k • 14

mlx-community/gemma-3-12b-it-4bit-DWQ

Text Generation • Updated 18 days ago • 647 • 2