Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

text-generation-inference

Inference Endpoints

Mixture of Experts

8-bit precision

Carbon Emissions

text-embeddings-inference

Models

7,164

Full-text search

Active filters: awq

cognitivecomputations/DeepSeek-R1-0528-AWQ

Text Generation • Updated 9 days ago • 7.73k • 12

Qwen/Qwen2.5-VL-3B-Instruct-AWQ

Image-Text-to-Text • Updated Apr 6 • 20.2k • 39

LGAI-EXAONE/EXAONE-Deep-7.8B-AWQ

Text Generation • Updated Mar 19 • 909 • 15

gaunernst/gemma-3-12b-it-int4-awq

Image-Text-to-Text • Updated Apr 6 • 6.95k • 12

gaunernst/gemma-3-27b-it-int4-awq

Image-Text-to-Text • Updated Apr 6 • 6.58k • 23

Qwen/Qwen2.5-VL-32B-Instruct-AWQ

Image-Text-to-Text • Updated Apr 6 • 66.4k • 45

Qwen/Qwen3-32B-AWQ

Text Generation • Updated 21 days ago • 105k • 66

hxac/DeepSeek-R1-0528-Qwen3-8B-AWQ-4bit

Text Generation • Updated 11 days ago • 994 • 4

speakleash/Bielik-11B-v2.6-Instruct-AWQ

Text Generation • Updated 5 days ago • 108 • 2

TheBloke/MythoMax-L2-13B-AWQ

Text Generation • Updated Nov 9, 2023 • 1.85k • 11

TheBloke/LLaMA2-13B-Tiefighter-AWQ

Text Generation • Updated Nov 9, 2023 • 1.03k • 39

TheBloke/meditron-7B-AWQ

Text Generation • Updated Nov 30, 2023 • 29.8k • 3

amazon/MistralLite-AWQ

Text Generation • Updated May 20, 2024 • 78 • 4

Qwen/Qwen2-VL-72B-Instruct-AWQ

Image-Text-to-Text • Updated Sep 25, 2024 • 5.72k • 50

Qwen/Qwen2.5-32B-Instruct-AWQ

Text Generation • Updated Oct 9, 2024 • 84.2k • 81

Qwen/Qwen2.5-72B-Instruct-AWQ

Text Generation • Updated Oct 9, 2024 • 100k • 68

TechxGenus/Mistral-Large-Instruct-2411-AWQ

Updated Nov 19, 2024 • 1.09k • 7

casperhansen/llama-3.3-70b-instruct-awq

Text Generation • Updated Dec 6, 2024 • 41.8k • 33

ibnzterrell/Meta-Llama-3.3-70B-Instruct-AWQ-INT4

Text Generation • Updated Dec 7, 2024 • 7.03k • 25

internlm/internlm3-8b-instruct-awq

Text Generation • Updated Jan 15 • 33 • 6

cognitivecomputations/DeepSeek-R1-AWQ

Text Generation • Updated Mar 29 • 7.05k • 81

Qwen/Qwen2.5-VL-72B-Instruct-AWQ

Image-Text-to-Text • Updated Mar 7 • 45.9k • 54

Qwen/Qwen2.5-VL-7B-Instruct-AWQ

Image-Text-to-Text • Updated Apr 6 • 216k • 72

gaunernst/gemma-3-4b-it-qat-autoawq

Image-Text-to-Text • Updated Apr 6 • 1.23k • 1

kishizaki-sci/Llama-4-Scout-17B-16E-Instruct-AWQ

Updated May 4 • 11.3k • 3

Sumo10/Phi-4-mini-instruct-AWQ-4bit

Updated Apr 25 • 45 • 1

Qwen/Qwen3-14B-AWQ

Text Generation • Updated 21 days ago • 51.3k • 23

cognitivecomputations/Qwen3-30B-A3B-AWQ

Text Generation • Updated May 2 • 14.4k • 12

Qwen/Qwen3-8B-AWQ

Text Generation • Updated 21 days ago • 106k • 7

Intel/DeepSeek-R1-0528-Qwen3-8B-int4-AutoRound-awq-inc

Updated 10 days ago • 1.51k • 1