Edit Models filters

Inference status

Misc

AutoTrain Compatible

text-generation-inference

4-bit precision

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Misc with no match

Carbon Emissions

Models

4,033

Full-text search

Active filters: gptq

TheBloke/deepseek-llm-67b-chat-GPTQ

Text Generation • Updated Nov 29, 2023 • 10 • 5

TheBloke/Mistral-7B-Instruct-v0.2-GPTQ

Text Generation • Updated Dec 11, 2023 • 49.2k • 47

TheBloke/dolphin-2.5-mixtral-8x7b-GPTQ

Text Generation • Updated Dec 14, 2023 • 142 • 96

TheBloke/DaringMaid-20B-GPTQ

Text Generation • Updated Dec 20, 2023 • 16 • 5

TheBloke/phi-2-electrical-engineering-GPTQ

Text Generation • Updated Jan 13 • 7 • 7

TheBloke/Nous-Hermes-2-Mixtral-8x7B-DPO-GPTQ

Text Generation • Updated Jan 16 • 832 • 26

explodinggradients/Ragas-critic-llm-Qwen1.5-GPTQ

Text Generation • Updated Apr 8 • 149 • 10

javiagu/KULLM3_GPTQ

Text Generation • Updated May 3 • 39 • 1

mgoin/Meta-Llama-3-70B-Instruct-GPTQ

Text Generation • Updated Apr 18 • 32 • 2

astronomer/Llama-3-8B-Instruct-GPTQ-8-Bit

Text Generation • Updated Apr 22 • 10.4k • 25

TechxGenus/Meta-Llama-3-70B-Instruct-GPTQ

Text Generation • Updated Apr 19 • 723 • 16

study-hjt/Qwen1.5-32B-Chat-GPTQ-Int8

Text Generation • Updated Apr 26 • 14 • 1

openerotica/Llama-3-lima-nsfw-16k-test-GPTQ

Text Generation • Updated May 17 • 52 • 5

Qwen/Qwen2-72B-Instruct-GPTQ-Int4

Text Generation • Updated Aug 21 • 10.5k • 31

Qwen/Qwen2-72B-Instruct-GPTQ-Int8

Text Generation • Updated Aug 21 • 9.73k • 14

Qwen/Qwen2-57B-A14B-Instruct-GPTQ-Int4

Text Generation • Updated Aug 21 • 589 • 22

Qwen/Qwen2-1.5B-Instruct-GPTQ-Int4

Text Generation • Updated Aug 21 • 9.76k • 3

Qwen/Qwen2-1.5B-Instruct-GPTQ-Int8

Text Generation • Updated Aug 21 • 1.24k • 3

Qwen/Qwen2-7B-Instruct-GPTQ-Int4

Text Generation • Updated Aug 21 • 5.1k • 22

kaitchup/Qwen2-7B-gptq-2bit

Text Generation • Updated Jun 11 • 1

bklynhlth/WillisDiarize-v1-quantized

Text Generation • Updated Aug 14 • 1

zgce/Yi-1.5-34B-Chat-GPTQ-Int8

Text Generation • Updated Jun 11 • 196 • 1

cstr/Spaetzle-v85-7b-int4-inc

Text Generation • Updated Jun 24 • 4 • 2

ModelCloud/gemma-2-9b-it-gptq-4bit

Text Generation • Updated Jul 9 • 14.1k • 3

Granther/Gemma-2-9B-Instruct-4Bit-GPTQ

Text Generation • Updated Jul 8 • 414 • 1

neuralmagic/Meta-Llama-3-8B-Instruct-quantized.w8a16

Text Generation • Updated Jul 18 • 578 • 1

neuralmagic/Meta-Llama-3-70B-Instruct-quantized.w8a16

Text Generation • Updated Jul 18 • 241 • 2

AI-MO/NuminaMath-7B-TIR-GPTQ

Text Generation • Updated Jul 9 • 252 • 4

pentagoniac/SEMIKONG-8b-GPTQ

Text Generation • Updated Jul 9 • 505 • 8

model-scope/glm-4-9b-chat-GPTQ-Int4

Text Generation • Updated Jul 17 • 730 • 4