-
-
-
-
-
-
Inference status
Active filters:
gptq
Qwen/Qwen2.5-72B-Instruct-GPTQ-Int4
Text Generation
•
Updated
•
807
•
10
Qwen/Qwen2.5-14B-Instruct-GPTQ-Int8
Text Generation
•
Updated
•
135
•
5
neuralmagic/Meta-Llama-3.1-70B-Instruct-quantized.w4a16
Text Generation
•
Updated
•
101k
•
19
Qwen/Qwen2.5-7B-Instruct-GPTQ-Int8
Text Generation
•
Updated
•
201
•
3
Qwen/Qwen2.5-14B-Instruct-GPTQ-Int4
Text Generation
•
Updated
•
263
•
3
Qwen/Qwen2.5-32B-Instruct-GPTQ-Int8
Text Generation
•
Updated
•
247
•
3
Qwen/Qwen2.5-72B-Instruct-GPTQ-Int8
Text Generation
•
Updated
•
428
•
3
ModelCloud/GRIN-MoE-gptq-4bit
Updated
•
6
•
3
speakleash/Bielik-11B-v2.2-Instruct-GPTQ
Text Generation
•
Updated
•
593
•
3
Qwen/Qwen2-VL-72B-Instruct-GPTQ-Int4
Image-Text-to-Text
•
Updated
•
608
•
2
Qwen/Qwen2.5-3B-Instruct-GPTQ-Int8
Text Generation
•
Updated
•
29
•
2
TheBloke/Wizard-Vicuna-13B-Uncensored-GPTQ
Text Generation
•
Updated
•
7.94k
•
313
TheBloke/airoboros-13B-gpt4-1.4-GPTQ
Text Generation
•
Updated
•
86
•
37
TheBloke/WizardLM-33B-V1-0-Uncensored-SuperHOT-8K-GPTQ
Text Generation
•
Updated
•
32
•
91
TheBloke/Wizard-Vicuna-13B-Uncensored-SuperHOT-8K-GPTQ
Text Generation
•
Updated
•
570
•
136
TheBloke/airoboros-13b-gpt4-1.4-SuperHOT-8K-GPTQ
Text Generation
•
Updated
•
30
•
31
TheBloke/Manticore-13B-Chat-Pyg-Guanaco-SuperHOT-8K-GPTQ
Text Generation
•
Updated
•
678
•
19
TheBloke/Chronoboros-33B-GPTQ
Text Generation
•
Updated
•
40
•
28
TheBloke/Llama-2-7B-GPTQ
Text Generation
•
Updated
•
17.1k
•
80
TheBloke/Llama-2-70B-Chat-GPTQ
Text Generation
•
Updated
•
10.9k
•
259
TheBloke/OpenAssistant-Llama2-13B-Orca-v2-8K-3166-GPTQ
Text Generation
•
Updated
•
17
•
25
TheBloke/MythoMax-L2-13B-GPTQ
Text Generation
•
Updated
•
5.76k
•
181
TheBloke/CodeLlama-7B-Instruct-GPTQ
Text Generation
•
Updated
•
137k
•
44
TheBloke/CodeLlama-13B-Instruct-GPTQ
Text Generation
•
Updated
•
1.02k
•
38
clibrain/Llama-2-7b-ft-instruct-es-gptq-4bit
Text Generation
•
Updated
•
63
•
9
TheBloke/Phind-CodeLlama-34B-v2-GPTQ
Text Generation
•
Updated
•
142
•
89
TheBloke/storytime-13B-GPTQ
Text Generation
•
Updated
•
317
•
26
TheBloke/Mistral-7B-OpenOrca-GPTQ
Text Generation
•
Updated
•
65.3k
•
100
TheBloke/AquilaChat2-34B-16K-GPTQ
Text Generation
•
Updated
•
11
•
6
TheBloke/Yarn-Mistral-7B-128k-GPTQ
Text Generation
•
Updated
•
51
•
13