Edit Models filters

Inference status

Misc

arxiv: 2210.17323

AutoTrain Compatible

text-generation-inference

Inference Endpoints

4-bit precision

8-bit precision

Carbon Emissions

Misc with no match

text-embeddings-inference

Mixture of Experts

Models

114

Full-text search

Active filters: 2210.17323

rinna/llama-3-youko-8b-instruct-gptq

Text Generation • Updated Aug 31 • 77 • 1

neuralmagic/Meta-Llama-3.1-8B-Instruct-quantized.w8a16

Text Generation • Updated 22 days ago • 5.16k • 9

neuralmagic/Meta-Llama-3.1-8B-Instruct-quantized.w8a8

Text Generation • Updated 22 days ago • 9.13k • 11

neuralmagic/Meta-Llama-3.1-70B-Instruct-quantized.w8a16

Text Generation • Updated Oct 9 • 1.4k • 3

neuralmagic/Meta-Llama-3.1-70B-Instruct-quantized.w8a8

Text Generation • Updated Oct 10 • 10.5k • 12

neuralmagic/Meta-Llama-3.1-70B-Instruct-quantized.w4a16

Text Generation • Updated Oct 10 • 17.9k • 25

neuralmagic/Meta-Llama-3.1-405B-Instruct-quantized.w4a16

Text Generation • Updated Oct 10 • 2.93k • 12

neuralmagic/gemma-2-9b-it-quantized.w4a16

Text Generation • Updated Oct 9 • 430 • 1

neuralmagic/gemma-2-9b-it-quantized.w8a8

Text Generation • Updated Oct 9 • 198 • 2

neuralmagic/Meta-Llama-3.1-405B-Instruct-quantized.w8a8

Text Generation • Updated Oct 10 • 910 • 2

neuralmagic/Llama-3.2-1B-Instruct-quantized.w8a8

Text Generation • Updated 29 days ago • 1.91k • 3

BelleGroup/BELLE-7B-gptq

Text2Text Generation • Updated Apr 20, 2023 • 5 • 26

sardukar/llama13b-4bit-v2

Text Generation • Updated Apr 8, 2023 • 12 • 5

sardukar/llama7b-4bit-v2

Text Generation • Updated Apr 6, 2023 • 8 • 3

BelleGroup/BELLE-LLaMA-7B-2M-gptq-enc

Text2Text Generation • Updated Apr 12, 2023 • 2

BelleGroup/BELLE_BLOOM_GPTQ_4BIT

Text Generation • Updated Apr 20, 2023 • 16 • 3

Thireus/Vicuna13B-v1.1-8bit-128g

Text Generation • Updated Apr 22, 2023 • 13 • 16

mayank-mishra/starcoderbase-GPTQ-4bit-128g

Updated May 5, 2023 • 21

mayank-mishra/starcoderbase-GPTQ-8bit-128g

Updated May 5, 2023 • 3

mayank-mishra/santacoder-GPTQ-8bit-128g

Updated May 4, 2023 • 1

mayank-mishra/santacoder-GPTQ-4bit-128g

Updated May 4, 2023 • 2

mayank-mishra/starcoder-GPTQ-4bit-128g

Updated May 5, 2023 • 16

mayank-mishra/starcoder-GPTQ-8bit-128g

Updated May 5, 2023 • 11

ssaroya/gptq_model

Updated May 25, 2023

Honkware/Manticore-13b-Landmark-GPTQ

Text Generation • Updated Jun 14, 2023 • 20 • 2

malhajar/Platypus2-70B-instruct-4bit-gptq

Text Generation • Updated Jan 29 • 800

clibrain/Llama-2-7b-ft-instruct-es-gptq-4bit

Text Generation • Updated Sep 1, 2023 • 21 • 9

clibrain/Llama-2-13b-ft-instruct-es-gptq-4bit

Text Generation • Updated Sep 4, 2023 • 22 • 3

malhajar/Uni-TianYan-4bit-gptq

Text Generation • Updated Sep 7, 2023 • 16

daedalus314/Griffin-3B-GPTQ

Text Generation • Updated Sep 8, 2023 • 17