Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

text-generation-inference

4-bit precision

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Misc with no match

Carbon Emissions

Models

6,116

Full-text search

Active filters: gptq

mratsim/GLM-4-32B-0414.w4a16-gptq

Text2Text Generation • Updated 11 days ago • 884 • 3

mratsim/Devstral-Small-2505.w4a16-gptq

Text2Text Generation • Updated 10 days ago • 779 • 2

TheBloke/Wizard-Vicuna-30B-Uncensored-GPTQ

Text Generation • Updated Sep 27, 2023 • 618 • 581

TheBloke/Llama-2-13B-chat-GPTQ

Text Generation • Updated Sep 27, 2023 • 3.87k • 365

TheBloke/MythoMax-L2-13B-GPTQ

Text Generation • Updated Sep 27, 2023 • 4.01k • 207

TheBloke/deepseek-coder-1.3b-instruct-GPTQ

Text Generation • Updated Nov 5, 2023 • 779 • 7

TheBloke/CapybaraHermes-2.5-Mistral-7B-GPTQ

Updated Jan 31, 2024 • 905 • 59

Qwen/Qwen1.5-4B-Chat-GPTQ-Int8

Text Generation • Updated Apr 30, 2024 • 27 • 6

venera-ai/SeaLLM-7B-v2.5-4bit

Text Generation • Updated Apr 27, 2024 • 18 • 2

Qwen/Qwen2.5-0.5B-Instruct-GPTQ-Int4

Text Generation • Updated Sep 19, 2024 • 3.14k • 8

Qwen/Qwen2.5-72B-Instruct-GPTQ-Int8

Text Generation • Updated Oct 9, 2024 • 2.3k • 25

openbmb/MiniCPM-o-2_6-int4

Any-to-Any • Updated 17 days ago • 4.32k • 46

AIDC-AI/Ovis2-4B-GPTQ-Int4

Image-Text-to-Text • Updated Mar 25 • 685 • 3

hjc4869/Llama-3.3-70B-Instruct-w4g32-auto-gptq

Updated Mar 28 • 16 • 1

wolfofbackstreet/DeepCoder-14B-Preview-int4-qptq-v1

Text Generation • Updated Apr 23 • 94 • 1

kaitchup/Qwen3-14B-autoround-4bit-gptq

Updated May 2 • 447 • 1

Qwen/Qwen3-235B-A22B-GPTQ-Int4

Text Generation • Updated 15 days ago • 6.93k • 14

QuantTrio/DeepSeek-R1-0528-Qwen3-8B-GPTQ-Int4-Int8Mix

Text Generation • Updated 6 days ago • 214 • 1

QuantTrio/DeepSeek-R1-0528-GPTQ-Int4-Int8Mix-Lite

Text Generation • Updated 1 day ago • 36 • 1

QuantTrio/DeepSeek-R1-0528-GPTQ-Int4-Int8Mix-Compact

Text Generation • Updated 1 day ago • 219 • 1

ziyingchen1106/Llama-3.2-3B-Instruct-fp16-lora-gptqmodel-4bit

Text Generation • Updated 4 days ago • 17 • 1

c1uc/Llama-3.2-3B-Instruct-lora-4bit-g128

Updated 2 days ago • 200 • 1

QuantTrio/DeepSeek-R1-0528-GPTQ-Int4-Int8Mix-Medium

Text Generation • Updated about 13 hours ago • 1

TheBloke/Xwin-MLewd-7B-V0.2-GPTQ

Text Generation • Updated Oct 31, 2023 • 43 • 22

elinas/alpaca-13b-lora-int4

Text Generation • Updated Apr 5, 2023 • 8 • 41

elinas/alpaca-30b-lora-int4

Text Generation • Updated Apr 5, 2023 • 11 • 68

mayaeary/pygmalion-6b-4bit-128g

Text Generation • Updated Mar 28, 2023 • 42 • 40

mayaeary/pygmalion-6b_dev-4bit-128g

Text Generation • Updated Mar 28, 2023 • 23 • 120

mayaeary/PPO_Pygway-V8p4_Dev-6b-4bit-128g

Text Generation • Updated Mar 31, 2023 • 13 • 2

mayaeary/PPO_Pygway-6b-Mix-4bit-128g

Text Generation • Updated Mar 31, 2023 • 18 • 2