neuralmagic/Mistral-Nemo-Instruct-2407-quantized.w4a16
Text Generation
•
Updated
•
845
•
2
Edit Models filters
Active filters:
2210.17323
neuralmagic/gemma-2-2b-it-quantized.w8a8
Text Generation
•
Updated
•
458
neuralmagic/Meta-Llama-3.1-405B-Instruct-quantized.w8a16
Text Generation
•
Updated
•
581
•
2
neuralmagic/SmolLM-360M-Instruct-quantized.w8a8
Text Generation
•
Updated
•
15
neuralmagic/SmolLM-135M-Instruct-quantized.w8a8
Text Generation
•
Updated
•
635
nm-testing/SmolLM-135M-Instruct-quantized.w4a16
Text Generation
•
Updated
•
14
nm-testing/SmolLM-1.7B-Instruct-quantized.w4a16
Text Generation
•
Updated
•
10
neuralmagic/SmolLM-1.7B-Instruct-quantized.w8a8
Text Generation
•
Updated
•
25
zzzmahesh/Meta-Llama-3-8B-Instruct-quantized.w8a8
Text Generation
•
Updated
•
8
zzzmahesh/Meta-Llama-3-8B-Instruct-quantized.w4a4
Text Generation
•
Updated
•
27
IntelLabs/sqft-phi-3-mini-4k-instruct-base-gptq
Text Generation
•
Updated
•
3
iproskurina/opt-125m-GPTQ-4bit-g128
Text Generation
•
Updated
•
24
iproskurina/Mistral-7B-v0.1-GPTQ-4bit-g128
Text Generation
•
Updated
•
12
iproskurina/Mistral-7B-v0.1-GPTQ-8bit-g128
Text Generation
•
Updated
•
34
iproskurina/Mistral-7B-v0.1-GPTQ-3bit-g128
Text Generation
•
Updated
•
14
iproskurina/Mistral-7B-v0.1-GPTQ-3bit-g64
Text Generation
•
Updated
•
13
iproskurina/Mistral-7B-v0.1-GPTQ-8bit-g64
Text Generation
•
Updated
•
15
iproskurina/Mistral-7B-v0.3-GPTQ-4bit-g128
Text Generation
•
Updated
•
23
iproskurina/Mistral-7B-v0.3-GPTQ-8bit-g128
Text Generation
•
Updated
•
39
neuralmagic/Llama-3.2-3B-Instruct-quantized.w8a8
Text Generation
•
Updated
•
1.63k
•
1
IntelLabs/sqft-phi-3.5-mini-instruct-base-gptq
Text Generation
•
Updated
•
3
BSC-LT/salamandra-7b-base-gptq
Text Generation
•
Updated
•
25
BSC-LT/salamandra-7b-instruct-gptq
Text Generation
•
Updated
•
49
BSC-LT/salamandra-2b-base-gptq
Text Generation
•
Updated
•
80