Inference Providers
Active filters: int4
JoaoZaokk/P-H3-Image-W4A16
Text-to-Image • Updated • 30
• 1
Reza2kn/Bina-0.4-Rizeh-LiteRT-INT4
Image-to-Text • Updated • 81
• 1
supz/Arete-27B-W4A16-AutoRound
Image-Text-to-Text • 6B • Updated • 123
• 1
TheUnderscore/Arete-27B-W4A16-AWQ
Image-Text-to-Text • 27B • Updated • 141
• 1
ryluxapp/flux2-klein-4b-int4-mlx
Image-to-Image • Updated • 1
Text Generation • Updated • 1
Image-to-3D • Updated • 1
xgirls/Qwen3-4B-uncensored-klein-text-encoder-int4-ov
TOWIN-AI/OLMo-3.1-32B-Think-GPTQ-Int4-16bit-output
Text Generation • 32B • Updated • 68
• 2
JoaoZaokk/10Eros-Max-beta6-W4A8-ConvRot
Image-Text-to-Video • Updated • 8.19k
• 2
Quiho/Anima_INT4_Quants_INT4_Convrot_MSE_checkpoint
Advantech-EIOT/intel_llama-2-chat-7b
Text Generation • Updated • 10
RedHatAI/zephyr-7b-beta-marlin
Text Generation • 1B • Updated • 72
RedHatAI/TinyLlama-1.1B-Chat-v1.0-marlin
Text Generation • 0.3B • Updated • 2.58k
• 2
RedHatAI/OpenHermes-2.5-Mistral-7B-marlin
Text Generation • 1B • Updated • 21
• 2
RedHatAI/Nous-Hermes-2-Yi-34B-marlin
Text Generation • 5B • Updated • 26
• 5
ecastera/ecastera-eva-westlake-7b-spanish-int4-gguf
7B • Updated • 29
• 2
softmax/Llama-2-70b-chat-hf-marlin
Text Generation • 10B • Updated • 5
softmax/falcon-180B-chat-marlin
Text Generation • 26B • Updated • 15
study-hjt/Meta-Llama-3-8B-Instruct-GPTQ-Int4
Text Generation • 8B • Updated • 12
study-hjt/Meta-Llama-3-70B-Instruct-GPTQ-Int4
Text Generation • 71B • Updated • 12
• 6
study-hjt/Meta-Llama-3-70B-Instruct-AWQ
Text Generation • 71B • Updated • 13
study-hjt/Qwen1.5-110B-Chat-GPTQ-Int4
Text Generation • 111B • Updated • 8
• 2
study-hjt/CodeQwen1.5-7B-Chat-GPTQ-Int4
Text Generation • 7B • Updated • 9
study-hjt/Qwen1.5-110B-Chat-AWQ
Text Generation • 111B • Updated • 6
modelscope/Yi-1.5-34B-Chat-AWQ
Text Generation • 34B • Updated • 32
• 2
modelscope/Yi-1.5-6B-Chat-GPTQ
Text Generation • 6B • Updated • 9
modelscope/Yi-1.5-6B-Chat-AWQ
Text Generation • 6B • Updated • 10
modelscope/Yi-1.5-9B-Chat-GPTQ
Text Generation • 9B • Updated • 12
• 1
modelscope/Yi-1.5-9B-Chat-AWQ
Text Generation • 9B • Updated • 75