Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

text-generation-inference

Inference Endpoints

Mixture of Experts

8-bit precision

Carbon Emissions

text-embeddings-inference

Models

7,163

Full-text search

Active filters: awq

winninghealth/WiNGPT-Babel-2-AWQ

Updated about 16 hours ago • 4 • 1

qdzzzxc/RuadaptQwen3-32B-Instruct-AWQ

Updated 1 day ago • 6 • 1

FrenzyBiscuit/The-Omega-Directive-Qwen3-14B-v1.1-AWQ

Text Generation • Updated 1 day ago • 19 • 2

casperhansen/mpt-7b-8k-chat-awq

Text Generation • Updated Nov 4, 2023 • 25 • 3

casperhansen/falcon-7b-awq

Text Generation • Updated Nov 4, 2023 • 47 • 1

casperhansen/vicuna-7b-v1.5-awq

Text Generation • Updated Oct 31, 2023 • 22 • 3

casperhansen/vicuna-7b-v1.5-awq-gemv

Text Generation • Updated Oct 31, 2023 • 24 • 1

casperhansen/mpt-7b-8k-chat-awq-gemv

Text Generation • Updated Oct 31, 2023 • 15

casperhansen/opt-125m-awq

Text Generation • Updated Oct 31, 2023 • 1.29k • 3

casperhansen/tinyllama-1b-awq

Text Generation • Updated Oct 31, 2023 • 4.35k

Bomml/Llama-2-70B-chat-w4-g128-awq

Text Generation • Updated Sep 16, 2023

TheBloke/Llama-2-7B-Chat-AWQ

Text Generation • Updated Nov 9, 2023 • 5.31k • 21

TheBloke/Llama-2-7B-AWQ

Text Generation • Updated Nov 9, 2023 • 961 • 16

TheBloke/Llama-2-13B-AWQ

Text Generation • Updated Nov 9, 2023 • 781 • 14

TheBloke/CodeLlama-13B-Python-AWQ

Text Generation • Updated Nov 9, 2023 • 12 • 2

TheBloke/CodeLlama-13B-Instruct-AWQ

Text Generation • Updated Nov 9, 2023 • 1.34k • 9

TheBloke/CodeLlama-13B-AWQ

Text Generation • Updated Nov 9, 2023 • 22 • 4

TheBloke/Llama-2-13B-chat-AWQ

Text Generation • Updated Nov 9, 2023 • 2.3k • 26

TheBloke/Llama-2-70B-AWQ

Text Generation • Updated Nov 9, 2023 • 877 • 14

TheBloke/Llama-2-70B-Chat-AWQ

Text Generation • Updated Nov 9, 2023 • 2.09k • 23

TheBloke/Luban-13B-AWQ

Text Generation • Updated Nov 9, 2023 • 12 • 1

TheBloke/CodeLlama-34B-Instruct-AWQ

Text Generation • Updated Nov 9, 2023 • 31 • 1

TheBloke/CodeLlama-34B-AWQ

Text Generation • Updated Nov 9, 2023 • 53 • 2

TheBloke/Marcoroni-13B-AWQ

Text Generation • Updated Nov 9, 2023 • 21

TheBloke/CodeLlama-7B-AWQ

Text Generation • Updated Nov 9, 2023 • 50 • 5

TheBloke/CodeLlama-7B-Instruct-AWQ

Text Generation • Updated Nov 9, 2023 • 1.06k • 4

TheBloke/CodeLlama-34B-Python-AWQ

Text Generation • Updated Nov 9, 2023 • 26 • 2

TheBloke/Marcoroni-70B-AWQ

Text Generation • Updated Nov 9, 2023 • 15 • 2

TheBloke/CodeLlama-7B-Python-AWQ

Text Generation • Updated Nov 9, 2023 • 84 • 4

TheBloke/Marcoroni-7b-AWQ

Text Generation • Updated Nov 9, 2023 • 12 • 1