Models

cpatonn/Qwen3-Next-80B-A3B-Instruct-AWQ-4bit

Text Generation • Updated about 11 hours ago • 10

cpatonn/Qwen3-Next-80B-A3B-Thinking-AWQ-4bit

Text Generation • Updated about 11 hours ago • 7

tencent/Hunyuan-MT-Chimera-7B-fp8

Translation • 8B • Updated 11 days ago • 484 • 20

zai-org/GLM-4.5-FP8

Text Generation • 358B • Updated Aug 12 • 29.6k • 70

tencent/Hunyuan-MT-7B-fp8

Translation • 8B • Updated 11 days ago • 1.52k • 23

NousResearch/Hermes-4-14B-FP8

Text Generation • 15B • Updated 9 days ago • 3.51k • 8

RedHatAI/Qwen2.5-VL-7B-Instruct-quantized.w8a8

Image-to-Text • 8B • Updated Apr 3 • 8.4k • 7

RedHatAI/whisper-large-v3-turbo-quantized.w8a8

Automatic Speech Recognition • 0.9B • Updated Apr 22 • 27.4k • 4

RedHatAI/whisper-large-v3-turbo-quantized.w4a16

Automatic Speech Recognition • 0.2B • Updated 7 days ago • 1.34k • 5

zai-org/GLM-4.5V-FP8

Image-Text-to-Text • 108B • Updated 26 days ago • 419k • 26

allenai/olmOCR-7B-0825-FP8

Image-to-Text • 8B • Updated about 1 month ago • 87.4k • 4

RedHatAI/Voxtral-Mini-3B-2507-FP8-dynamic

Automatic Speech Recognition • 5B • Updated 2 days ago • 784 • 4

cpatonn/ERNIE-4.5-21B-A3B-Thinking-AWQ-4bit

Text Generation • 5B • Updated 4 days ago • 216 • 2

RedHatAI/DeepSeek-R1-Distill-Llama-70B-quantized.w4a16

Text Generation • 11B • Updated Feb 27 • 1.86k • 5

RedHatAI/Qwen2.5-VL-7B-Instruct-quantized.w4a16

Image-to-Text • 3B • Updated Apr 3 • 1.49k • 7

RedHatAI/Qwen2.5-VL-3B-Instruct-quantized.w4a16

Image-to-Text • 2B • Updated Apr 3 • 1.34k • 3

RedHatAI/Qwen2.5-VL-72B-Instruct-quantized.w4a16

Image-to-Text • 13B • Updated Jul 10 • 2.09k • 8

leon-se/gemma-3-27b-it-FP8-Dynamic

27B • Updated Apr 8 • 4.09k • 18

ISTA-DASLab/gemma-3-27b-it-GPTQ-4b-128g

Image-Text-to-Text • 5B • Updated Mar 20 • 24.9k • 40

RedHatAI/whisper-large-v3-FP8-dynamic

Automatic Speech Recognition • 2B • Updated Apr 22 • 242 • 1

meta-llama/Llama-4-Maverick-17B-128E-Instruct-FP8

Image-Text-to-Text • 402B • Updated May 22 • 88.3k • • 130

nytopop/Qwen3-32B.w4a16

Text Generation • 6B • Updated Apr 29 • 9 • 1

RedHatAI/Qwen3-1.7B-quantized.w4a16

Text Generation • 0.8B • Updated May 12 • 2.28k • 3

RedHatAI/Qwen3-30B-A3B-quantized.w4a16

Text Generation • 5B • Updated May 13 • 1.79k • 4

RedHatAI/gemma-3-27b-it-quantized.w4a16

Image-Text-to-Text • 7B • Updated Jun 9 • 7.64k • 6

yujiepan/ui-tars-1.5-7B-GPTQ-W4A16g128

Image-Text-to-Text • 3B • Updated Jun 5 • 151 • 1

boboliu/Qwen3-Embedding-4B-W4A16-G128

Feature Extraction • 0.9B • Updated Jun 7 • 772 • 3

stelterlab/Mistral-Small-3.2-24B-Instruct-2506-FP8

Image-Text-to-Text • Updated Jun 26 • 9.09k • 7

zankich/Qwen3-32B-INT8

Text Generation • 33B • Updated Jun 30 • 21 • 1

ai21labs/AI21-Jamba-Mini-1.7-FP8

52B • Updated Jul 6 • 4.1k • 1