Edit Models filters

Apps

Inference Providers

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Mixture of Experts

Carbon Emissions

Models

86

Full-text search

Active filters: sparsity

RedHatAI/Sparse-Llama-3.1-8B-evolcodealpaca-2of4-FP8-dynamic

Text Generation • 8B • Updated Dec 19, 2024 • 5

RedHatAI/Sparse-Llama-3.1-8B-ultrachat_200k-2of4-FP8-dynamic

Text Generation • 8B • Updated Dec 19, 2024 • 6 • 1

RedHatAI/Sparse-Llama-3.1-8B-2of4

Text Generation • 8B • Updated Dec 16, 2024 • 39 • 62

RedHatAI/Sparse-Llama-3.1-8B-ultrachat_200k-2of4-quantized.w4a16

Text Generation • 2B • Updated Dec 19, 2024 • 9 • 3

RedHatAI/Sparse-Llama-3.1-8B-ultrachat_200k-2of4

Text Generation • 8B • Updated Nov 21, 2024 • 10 • 1

RedHatAI/Sparse-Llama-3.1-8B-evolcodealpaca-2of4

Text Generation • 8B • Updated Nov 21, 2024 • 5 • 1

RedHatAI/Sparse-Llama-3.1-8B-evolcodealpaca-2of4-quantized.w4a16

Text Generation • 2B • Updated Dec 19, 2024 • 6

RedHatAI/Sparse-Llama-3.1-8B-gsm8k-2of4-quantized.w4a16

Text Generation • 2B • Updated Dec 19, 2024 • 6

bartowski/Sparse-Llama-3.1-8B-2of4-GGUF

Text Generation • 8B • Updated Nov 26, 2024 • 1.3k • 3

QuantFactory/Sparse-Llama-3.1-8B-2of4-GGUF

Text Generation • 8B • Updated Nov 27, 2024 • 335 • 4

tensorblock/Sparse-Llama-3.1-8B-2of4-GGUF

Text Generation • 8B • Updated Jul 9 • 275

nintwentydo/pixtral-12b-2409-2of4-sparse

Image-Text-to-Text • 13B • Updated Jan 5 • 1

HangGuo/Llama2-70B-QuaRot-OBR-GPTQ-W4A4KV4S50

Text Generation • Updated 25 days ago • 26 • 1

HangGuo/Llama2-70B-QuaRot-OBR-RTN-W4A4KV4S50

Text Generation • Updated 25 days ago • 3

HangGuo/Llama2-70B-SpinQuant-OBR-RTN-W4A4KV4S50

Text Generation • Updated 25 days ago • 3

HangGuo/Llama2-70B-SpinQuant-OBR-GPTQ-W4A4KV4S50

Text Generation • Updated 25 days ago • 7

HangGuo/Llama3-70B-SpinQuant-OBR-GPTQ-W4A4KV4S50

Text Generation • Updated 25 days ago • 7

HangGuo/Llama3-70B-SpinQuant-OBR-RTN-W4A4KV4S50

Text Generation • Updated 25 days ago • 4

HangGuo/Llama3-70B-QuaRot-OBR-RTN-W4A4KV16S50

Text Generation • Updated 25 days ago • 6

HangGuo/Llama3-70B-QuaRot-OBR-GPTQ-W4A4KV16S50

Text Generation • Updated 25 days ago • 5

HangGuo/QWen2.5-7B-FlatQuant-OBR-GPTQ-W4A4KV4S50

Text Generation • Updated 25 days ago • 6

HangGuo/QWen2.5-32B-FlatQuant-OBR-GPTQ-W4A4KV4S50

Text Generation • Updated 25 days ago • 7

HangGuo/QWen2.5-1.5B-FlatQuant-OBR-GPTQ-W4A8KV16S50

Text Generation • Updated 25 days ago • 3

HangGuo/QWen2.5-3B-FlatQuant-OBR-GPTQ-W4A8KV16S50

Text Generation • Updated 25 days ago • 5

HangGuo/QWen2.5-3B-FlatQuant-OBR-GPTQ-W4A4KV4S50

Text Generation • Updated 25 days ago • 16

HangGuo/QWen2.5-1.5B-FlatQuant-OBR-GPTQ-W4A4KV4S50

Text Generation • Updated 25 days ago • 9