Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

text-generation-inference

4-bit precision

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Misc with no match

Carbon Emissions

Models

6,134

Full-text search

Active filters: gptq

openbmb/MiniCPM4-8B-Eagle-FRSpec-QAT-cpmcu

Text Generation • Updated about 11 hours ago • 9 • 6

openbmb/MiniCPM4-8B-marlin-cpmcu

Text Generation • Updated about 11 hours ago • 9 • 5

openbmb/MiniCPM4-8B-marlin-Eagle-vLLM

Text Generation • Updated about 11 hours ago • 4

openbmb/MiniCPM4-8B-marlin-vLLM

Text Generation • Updated about 11 hours ago • 4

mratsim/GLM-4-32B-0414.w4a16-gptq

Text2Text Generation • Updated 13 days ago • 929 • 3

mratsim/Devstral-Small-2505.w4a16-gptq

Text2Text Generation • Updated 12 days ago • 1.68k • 2

TheBloke/Llama-2-13B-chat-GPTQ

Text Generation • Updated Sep 27, 2023 • 3.68k • 365

TheBloke/CodeLlama-7B-Python-GPTQ

Text Generation • Updated Sep 27, 2023 • 63 • 24

TheBloke/WizardCoder-Python-13B-V1.0-GPTQ

Text Generation • Updated Sep 27, 2023 • 348 • 76

TheBloke/deepseek-coder-1.3b-instruct-GPTQ

Text Generation • Updated Nov 5, 2023 • 813 • 7

Qwen/Qwen1.5-4B-Chat-GPTQ-Int8

Text Generation • Updated Apr 30, 2024 • 29 • 6

venera-ai/SeaLLM-7B-v2.5-4bit

Text Generation • Updated Apr 27, 2024 • 21 • 2

Qwen/Qwen2.5-72B-Instruct-GPTQ-Int8

Text Generation • Updated Oct 9, 2024 • 2.19k • 25

AIDC-AI/Ovis2-4B-GPTQ-Int4

Image-Text-to-Text • Updated Mar 25 • 677 • 3

hjc4869/Llama-3.3-70B-Instruct-w4g32-auto-gptq

Updated Mar 28 • 21 • 1

wolfofbackstreet/DeepCoder-14B-Preview-int4-qptq-v1

Text Generation • Updated Apr 23 • 94 • 1

kaitchup/Qwen3-14B-autoround-4bit-gptq

Updated May 2 • 485 • 1

Qwen/Qwen3-235B-A22B-GPTQ-Int4

Text Generation • Updated 17 days ago • 7.32k • 14

QuantTrio/DeepSeek-R1-0528-GPTQ-Int4-Int8Mix-Lite

Text Generation • Updated 3 days ago • 49 • 1

QuantTrio/DeepSeek-R1-0528-GPTQ-Int4-Int8Mix-Compact

Text Generation • Updated 3 days ago • 302 • 1

ziyingchen1106/Llama-3.2-3B-Instruct-fp16-lora-gptqmodel-4bit

Text Generation • Updated 5 days ago • 23 • 1

c1uc/Llama-3.2-3B-Instruct-lora-4bit-g128

Updated 3 days ago • 361 • 1

QuantTrio/DeepSeek-R1-0528-GPTQ-Int4-Int8Mix-Medium

Text Generation • Updated 2 days ago • 40 • 1

TheBloke/Xwin-MLewd-7B-V0.2-GPTQ

Text Generation • Updated Oct 31, 2023 • 43 • 22

elinas/alpaca-13b-lora-int4

Text Generation • Updated Apr 5, 2023 • 8 • 41

elinas/alpaca-30b-lora-int4

Text Generation • Updated Apr 5, 2023 • 11 • 68

mayaeary/pygmalion-6b-4bit-128g

Text Generation • Updated Mar 28, 2023 • 43 • 40

mayaeary/pygmalion-6b_dev-4bit-128g

Text Generation • Updated Mar 28, 2023 • 26 • 120

mayaeary/PPO_Pygway-V8p4_Dev-6b-4bit-128g

Text Generation • Updated Mar 31, 2023 • 17 • 2

mayaeary/PPO_Pygway-6b-Mix-4bit-128g

Text Generation • Updated Mar 31, 2023 • 18 • 2