Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

compressed-tensors

Inference Endpoints

text-generation-inference

8-bit precision

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Misc with no match

4-bit precision

Models

1,760

Full-text search

Active filters: compressed-tensors

RedHatAI/Sparse-Llama-3.1-8B-tldr-2of4-FP8-dynamic

Text Generation • Updated 2 days ago • 113

yujiepan/ui-tars-1.5-7B-GPTQ-W4A16g128

Image-Text-to-Text • Updated 4 days ago • 11

yujiepan/ui-tars-1.5-7B-FP8-Dynamic

Updated 4 days ago • 14

duydq12/Qwen3-4B-FP8-dynamic

Updated 4 days ago • 99

lomimi/MNLP_M3_mcqa_model_merged_v4-FP8-Dynamic-Calib

Text Generation • Updated 4 days ago • 11

EmbeddedLLM/Qwen2.5-7B-Instruct-FP8-Dynamic

Updated 4 days ago • 3

mkartofel/Qwen3-0.6B-llmcompressor-W8A8-calib_ultrachat_512

Text Generation • Updated 4 days ago • 5

clejordan/MNLP_M3_W8A8llmcompressor

Text Generation • Updated 3 days ago • 51

clejordan/MNLP_M3_W4A16llmcompressor

Text Generation • Updated 3 days ago • 30

mina5rovic/qwen3-0.6b-mcqa-quant-w8a8-matyabase

Text Generation • Updated 4 days ago • 9

MikiV/LLMC_8bits_32blocksize_Qwen3-0.6B

Text Generation • Updated 4 days ago • 16

noneUsername/Cydonia-24B-v3-W8A8

Updated 4 days ago • 5

mkartofel/Qwen3-0.6B-llmcompressor-W4A16-calib_ultrachat_512

Text Generation • Updated 4 days ago • 9

RasmusVeski/MNLP_M3_quantized_model_lr5eminus5_W8_A8

Text Generation • Updated 4 days ago • 25

tranhuonglan/Qwen3-06B-base-quantization-modifier-w8a8

Text Generation • Updated 2 days ago • 9

SekoiaTree/MNLP_quantized_model_scratch

Text Generation • Updated about 10 hours ago • 22

nm-testing/TinyLlama-1.1B-Chat-v1.0-NVFP4A16

Updated 3 days ago • 80

RedHatAI/gemma-3-1b-it-quantized.w8a8

Text Generation • Updated 2 days ago • 5

luciehmct/MNLP_M3_quantized_model_w8a8

Text Generation • Updated 1 day ago • 26

luciehmct/MNLP_M3_quantized_model_w4a16

Text Generation • Updated 1 day ago • 38

luciehmct/MNLP_M3_quantized_model_W4A4

Text Generation • Updated 1 day ago • 26

RedHatAI/gemma-3-1b-it-quantized.w4a16

Text Generation • Updated 2 days ago • 5

sajal09/Calib_64_32

Text Generation • Updated 3 days ago • 13

sajal09/Calib128_64

Text Generation • Updated 3 days ago • 28

sajal09/Calib256_128

Text Generation • Updated 3 days ago • 7

sajal09/Calib512_256

Text Generation • Updated 3 days ago • 11

clejordan/MNLP_M3_QAT-llmcompress

Text Generation • Updated 3 days ago • 21

sajal09/Calib32_16

Text Generation • Updated 3 days ago • 10

FF2416/quant_test

Text Generation • Updated 3 days ago • 27

aviather/MNLP_M3_quantized_model

Text Generation • Updated 3 days ago • 23