Edit Models filters

Inference status

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

Mixture of Experts

8-bit precision

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

5,666

Full-text search

Active filters: awq

KirillR/QwQ-32B-Preview-AWQ

Text Generation • Updated Nov 27, 2024 • 15k • 18

cognitivecomputations/DeepSeek-V3-AWQ

Text Generation • Updated 12 days ago • 2.32k • 10

internlm/internlm3-8b-instruct-awq

Text Generation • Updated 3 days ago • 62 • 3

casperhansen/llama-3-8b-instruct-awq

Text Generation • Updated Jun 8, 2024 • 5.02k • 22

TheBloke/30B-Epsilon-AWQ

Text Generation • Updated Nov 9, 2023 • 58 • 3

MohamedRashad/AceGPT-13B-chat-AWQ

Text Generation • Updated Nov 18, 2023 • 59 • 3

Qwen/Qwen2-7B-Instruct-AWQ

Text Generation • Updated Aug 21, 2024 • 740 • 20

cecibas/Midnight-Miqu-70B-v1.5-4bit

Text Generation • Updated Jun 7, 2024 • 531k • 3

TechxGenus/DeepSeek-V2-Lite-Chat-AWQ

Text Generation • Updated Jul 4, 2024 • 23 • 2

hugging-quants/Meta-Llama-3.1-70B-Instruct-AWQ-INT4

Text Generation • Updated Aug 7, 2024 • 206k • 95

solidrust/Meta-Llama-3.1-8B-Instruct-abliterated-AWQ

Text Generation • Updated Sep 3, 2024 • 257 • 3

Qwen/Qwen2-VL-2B-Instruct-AWQ

Image-Text-to-Text • Updated Sep 21, 2024 • 6.85k • 20

Qwen/Qwen2.5-0.5B-Instruct-AWQ

Text Generation • Updated Oct 9, 2024 • 2.4k • 6

Qwen/Qwen2.5-7B-Instruct-AWQ

Text Generation • Updated Oct 9, 2024 • 11.8k • 17

AMead10/Llama-3.2-1B-Instruct-AWQ

Text Generation • Updated Sep 25, 2024 • 3.06k • 4

Qwen/Qwen2.5-Coder-32B-Instruct-AWQ

Text Generation • Updated Nov 18, 2024 • 41k • 19

Qwen/Qwen2.5-Coder-14B-Instruct-AWQ

Text Generation • Updated 6 days ago • 2.68k • 5

kosbu/Athene-V2-Chat-AWQ

Text Generation • Updated Nov 29, 2024 • 1.28k • 6

OPEA/QwQ-32B-Preview-int4-sym-mixed-awq-inc

Updated 26 days ago • 22 • 1

casperhansen/llama-3.3-70b-instruct-awq

Text Generation • Updated Dec 6, 2024 • 29.1k • 23

ibnzterrell/Meta-Llama-3.3-70B-Instruct-AWQ-INT4

Text Generation • Updated Dec 7, 2024 • 19.3k • 14

casperhansen/mpt-7b-8k-chat-awq

Text Generation • Updated Nov 4, 2023 • 18 • 3

casperhansen/falcon-7b-awq

Text Generation • Updated Nov 4, 2023 • 74 • 1

casperhansen/vicuna-7b-v1.5-awq

Text Generation • Updated Oct 31, 2023 • 36 • 3

casperhansen/vicuna-7b-v1.5-awq-gemv

Text Generation • Updated Oct 31, 2023 • 15 • 1

casperhansen/mpt-7b-8k-chat-awq-gemv

Text Generation • Updated Oct 31, 2023 • 13

casperhansen/opt-125m-awq

Text Generation • Updated Oct 31, 2023 • 400 • 3

casperhansen/tinyllama-1b-awq

Text Generation • Updated Oct 31, 2023 • 3.96k

Bomml/Llama-2-70B-chat-w4-g128-awq

Text Generation • Updated Sep 16, 2023

TheBloke/Llama-2-7B-Chat-AWQ

Text Generation • Updated Nov 9, 2023 • 3.66k • 20