Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

Mixture of Experts

8-bit precision

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

6,850

Full-text search

Active filters: awq

gaunernst/gemma-3-27b-it-int4-awq

Image-Text-to-Text • Updated 8 days ago • 12.2k • 15

Qwen/Qwen2.5-VL-32B-Instruct-AWQ

Image-Text-to-Text • Updated 7 days ago • 27.7k • 31

stelterlab/openhands-lm-32b-v0.1-AWQ

Text Generation • Updated 11 days ago • 2.29k • 7

Qwen/Qwen2.5-14B-Instruct-AWQ

Text Generation • Updated Oct 9, 2024 • 66.6k • 22

Qwen/Qwen2.5-VL-7B-Instruct-AWQ

Image-Text-to-Text • Updated 7 days ago • 90.7k • 50

cognitivecomputations/DeepSeek-V3-0324-AWQ

Text Generation • Updated 16 days ago • 11.7k • 14

Qwen/Qwen2.5-32B-Instruct-AWQ

Text Generation • Updated Oct 9, 2024 • 69.9k • 70

Valdemardi/DeepSeek-R1-Distill-Qwen-32B-AWQ

Text Generation • Updated Jan 20 • 13.4k • 28

cognitivecomputations/DeepSeek-R1-AWQ

Text Generation • Updated 16 days ago • 31.2k • 77

graelo/Qwen2.5-7B-Instruct-1M-AWQ

Updated Jan 29 • 330 • 3

Qwen/QwQ-32B-AWQ

Text Generation • Updated Mar 11 • 166k • 109

gaunernst/gemma-3-12b-it-int4-awq

Image-Text-to-Text • Updated 8 days ago • 3.25k • 9

OPEA/Mistral-Small-3.1-24B-Instruct-2503-int4-AutoRound-awq-sym

Updated 26 days ago • 107k • 10

TheBloke/Llama-2-7B-Chat-AWQ

Text Generation • Updated Nov 9, 2023 • 7.96k • 21

TheBloke/Yarn-Llama-2-7B-128K-AWQ

Text Generation • Updated Nov 9, 2023 • 75 • 1

TheBloke/13B-Chimera-AWQ

Text Generation • Updated Nov 9, 2023 • 20 • 2

TheBloke/30B-Epsilon-AWQ

Text Generation • Updated Nov 9, 2023 • 12 • 3

TheBloke/Wizard-Vicuna-30B-Uncensored-AWQ

Text Generation • Updated Nov 9, 2023 • 23 • 13

TheBloke/Wizard-Vicuna-7B-Uncensored-AWQ

Text Generation • Updated Nov 9, 2023 • 60 • 7

TheBloke/Mistral-7B-v0.1-AWQ

Text Generation • Updated Nov 9, 2023 • 1.17k • 30

TheBloke/Mistral-7B-Instruct-v0.1-AWQ

Text Generation • Updated Nov 9, 2023 • 2.11k • 38

TheBloke/zephyr-7B-alpha-AWQ

Text Generation • Updated Nov 9, 2023 • 75 • 18

TheBloke/llava-v1.5-13B-AWQ

Text Generation • Updated Nov 9, 2023 • 90 • 35

TheBloke/Yarn-Mistral-7B-128k-AWQ

Text Generation • Updated Nov 9, 2023 • 708 • 72

TheBloke/deepseek-coder-33B-instruct-AWQ

Text Generation • Updated Nov 13, 2023 • 1.05k • 36

TheBloke/deepseek-coder-6.7B-instruct-AWQ

Text Generation • Updated Nov 13, 2023 • 227 • 16

TheBloke/deepseek-coder-6.7B-base-AWQ

Text Generation • Updated Nov 9, 2023 • 332 • 9

TheBloke/LLaMA2-13B-TiefighterLR-AWQ

Text Generation • Updated Nov 9, 2023 • 43 • 2

TheBloke/open-llama-3b-v2-wizard-evol-instuct-v2-196k-AWQ

Text Generation • Updated Nov 30, 2023 • 77 • 1

TheBloke/deepseek-llm-7B-base-AWQ

Text Generation • Updated Nov 29, 2023 • 224 • 2