Edit Models filters

Inference status

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

14,746

Full-text search

Active filters: 4-bit

Qwen/Qwen2.5-32B-Instruct-AWQ

Text Generation • Updated 3 days ago • 548 • 13

Qwen/Qwen2.5-72B-Instruct-GPTQ-Int4

Text Generation • Updated 3 days ago • 807 • 10

Qwen/Qwen2-VL-72B-Instruct-AWQ

Image-Text-to-Text • Updated 1 day ago • 778 • 9

Qwen/Qwen2.5-72B-Instruct-AWQ

Text Generation • Updated 3 days ago • 695 • 9

unsloth/Meta-Llama-3.1-8B-bnb-4bit

Text Generation • Updated 19 days ago • 298k • 66

MaziyarPanahi/solar-pro-preview-instruct-GGUF

Text Generation • Updated 9 days ago • 7.71k • 13

flowaicom/Flow-Judge-v0.1-AWQ

Text Generation • Updated 4 days ago • 345 • 5

Qwen/Qwen2.5-14B-Instruct-AWQ

Text Generation • Updated 3 days ago • 4.83k • 5

neuralmagic/Meta-Llama-3.1-70B-Instruct-quantized.w4a16

Text Generation • Updated Aug 13 • 101k • 19

openbmb/MiniCPM-V-2_6-int4

Visual Question Answering • Updated Aug 8 • 13.1k • 55

pzc163/MiniCPMv2_6-prompt-generator

Updated 29 days ago • 1.6k • 30

Qwen/Qwen2-VL-7B-Instruct-AWQ

Image-Text-to-Text • Updated 1 day ago • 9.42k • 21

CohereForAI/c4ai-command-r-plus-4bit

Text Generation • Updated Aug 13 • 661 • 239

openbmb/MiniCPM-Llama3-V-2_5-int4

Visual Question Answering • Updated Jul 22 • 22.7k • 70

DataPilot/gemma2-Intelligent-Investor-5b-v2.5

Text2Text Generation • Updated 6 days ago • 17 • 3

Qwen/Qwen2.5-14B-Instruct-GPTQ-Int4

Text Generation • Updated 3 days ago • 263 • 3

ModelCloud/GRIN-MoE-gptq-4bit

Updated 3 days ago • 6 • 3

MaziyarPanahi/BioMistral-7B-GGUF

Text Generation • Updated Feb 19 • 913 • 43

MaziyarPanahi/Meta-Llama-3-70B-Instruct-GGUF

Text Generation • Updated May 14 • 2.34k • 162

hugging-quants/Meta-Llama-3.1-8B-Instruct-AWQ-INT4

Text Generation • Updated Aug 7 • 322k • 53

unsloth/Meta-Llama-3.1-70B-bnb-4bit

Text Generation • Updated 19 days ago • 11.2k • 21

speakleash/Bielik-11B-v2.2-Instruct-GPTQ

Text Generation • Updated 25 days ago • 593 • 3

speakleash/Bielik-11B-v2.2-Instruct-AWQ

Text Generation • Updated 25 days ago • 132 • 3

Qwen/Qwen2-VL-72B-Instruct-GPTQ-Int4

Image-Text-to-Text • Updated 1 day ago • 608 • 2

Qwen/Qwen2.5-7B-Instruct-AWQ

Text Generation • Updated 3 days ago • 559 • 2

LoneStriker/Mistral-Small-Instruct-2409-4.0bpw-h6-exl2

Updated 5 days ago • 46 • 2

MaziyarPanahi/Mistral-Small-Instruct-2409-GGUF

Text Generation • Updated 5 days ago • 150 • 2

unsloth/Qwen2.5-7B-Instruct-bnb-4bit

Text Generation • Updated 4 days ago • 230 • 2

unsloth/Qwen2.5-3B-Instruct-bnb-4bit

Text Generation • Updated 4 days ago • 63 • 2

unsloth/Qwen2.5-32B-Instruct-bnb-4bit

Text Generation • Updated 4 days ago • 157 • 2