Models

AIDC-AI/Ovis2-16B-GPTQ-Int4

Image-Text-to-Text • 5B • Updated Mar 25 • 1.36k • 5

TheBloke/Wizard-Vicuna-13B-Uncensored-SuperHOT-8K-GPTQ

Text Generation • 2B • Updated Aug 21, 2023 • 980 • 149

TheBloke/Nous-Hermes-Llama2-GPTQ

Text Generation • 2B • Updated Sep 27, 2023 • 886 • 60

Qwen/Qwen-VL-Chat-Int4

Text Generation • 4B • Updated Jan 25, 2024 • 3.05k • 92

TheBloke/LLaMA2-13B-Tiefighter-GPTQ

Text Generation • 2B • Updated Oct 22, 2023 • 31 • 34

TheBloke/Mixtral-8x7B-Instruct-v0.1-GPTQ

Text Generation • 6B • Updated Dec 14, 2023 • 66.8k • 138

TheBloke/Mistral-7B-Instruct-v0.2-GPTQ

Text Generation • 1B • Updated Dec 11, 2023 • 74.8k • 53

eralFlare/gemma-2b-it-gptq

Text Generation • 0.8B • Updated Mar 5, 2024 • 7 • 1

Qwen/Qwen1.5-MoE-A2.7B-Chat-GPTQ-Int4

Text Generation • 2B • Updated Jun 9, 2024 • 1.14k • 46

Qwen/Qwen2-7B-Instruct-GPTQ-Int4

Text Generation • 2B • Updated Aug 21, 2024 • 2.91k • 28

hugging-quants/Meta-Llama-3.1-8B-Instruct-GPTQ-INT4

Text Generation • 2B • Updated Aug 7, 2024 • 25.5k • 27

shuyuej/Mistral-Nemo-Instruct-2407-GPTQ-INT8

4B • Updated Aug 7, 2024 • 156 • 3

Qwen/Qwen2.5-32B-Instruct-GPTQ-Int4

Text Generation • 6B • Updated Oct 9, 2024 • 156k • 36

Qwen/Qwen2.5-32B-Instruct-GPTQ-Int8

Text Generation • 10B • Updated Oct 9, 2024 • 81.9k • 11

shuyuej/Llama-3.2-3B-Instruct-GPTQ

0.8B • Updated Sep 25, 2024 • 1.57k • 1

xmadai/Mistral-Large-Instruct-2407-xMADai-INT4

Text Generation • 17B • Updated Oct 30, 2024 • 17 • 7

AIDC-AI/Ovis2-8B-GPTQ-Int4

Image-Text-to-Text • 3B • Updated Mar 25 • 3.32k • 3

kaitchup/Qwen3-0.6B-autoround-4bit-gptq

0.2B • Updated May 2 • 30 • 2

rastabastamon/qwen-2.5-7b-gptq-4bit

2B • Updated May 5 • 1 • 1

Intel/DeepSeek-R1-0528-Qwen3-8B-int4-AutoRound-gptq-inc

2B • Updated Jun 1 • 11.6k • 3

numind/NuExtract-2.0-4B-GPTQ

Image-Text-to-Text • 1B • Updated 30 days ago • 181 • 2

numind/NuExtract-2.0-8B-GPTQ

Image-Text-to-Text • 3B • Updated 30 days ago • 393 • 3

ramgpt/jan-nano-4b-gptqmodel-4bit

Text Generation • 0.9B • Updated Jun 20 • 261 • 2

tencent/Hunyuan-A13B-Instruct-GPTQ-Int4

Text Generation • 11B • Updated 14 days ago • 103k • 47

elinas/alpaca-13b-lora-int4

Text Generation • Updated Apr 5, 2023 • 8 • 41

elinas/alpaca-30b-lora-int4

Text Generation • Updated Apr 5, 2023 • 11 • 68

mayaeary/pygmalion-6b-4bit-128g

Text Generation • Updated Mar 28, 2023 • 43 • 40

mayaeary/pygmalion-6b_dev-4bit-128g

Text Generation • Updated Mar 28, 2023 • 17 • 120

mayaeary/PPO_Pygway-V8p4_Dev-6b-4bit-128g

Text Generation • Updated Mar 31, 2023 • 4 • 2

mayaeary/PPO_Pygway-6b-Mix-4bit-128g

Text Generation • Updated Mar 31, 2023 • 5 • 2