Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

8-bit precision

4-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

719

Full-text search

Active filters: vllm

mradermacher/EraX-Translator-V1.0-GGUF

Translation • Updated Apr 14 • 152 • 1

erax-ai/EraX-Translator-V1.0-GGUF

Translation • Updated May 6 • 865 • 6

adriabama06/DeepCoder-1.5B-Preview-AWQ

Text Generation • Updated Apr 13 • 13 • 2

adriabama06/DeepCoder-1.5B-Preview-GPTQ-8bit

Text Generation • Updated Apr 13 • 18 • 1

adriabama06/DeepCoder-1.5B-Preview-FP8-W8A8

Text Generation • Updated Apr 13 • 16 • 1

mradermacher/EraX-Translator-V1.0-i1-GGUF

Translation • Updated Apr 14 • 454 • 1

Zaynoid/jsl-mistral-24b-spanish

Image-Text-to-Text • Updated Apr 16 • 9

FriendliAI/Mistral-Small-3.1-24B-Instruct-2503

Image-Text-to-Text • Updated Apr 14 • 27

RedHatAI/Mistral-Small-3.1-24B-Instruct-2503-quantized.w4a16

Image-Text-to-Text • Updated 10 days ago • 1.45k • 4

VinkuraAI/KunoRZN-Llama-3-3B

Text Generation • Updated Apr 16 • 8.84k • 4

imkebe/Mistral-Small-3.1-24B-Instruct-2503-rk3588-1.2.0

Image-Text-to-Text • Updated Apr 15 • 8

mradermacher/KunoRZN-Llama-3-3B-GGUF

Updated Apr 18 • 69 • 1

nm-testing/Mistral-Small-3.1-24B-Instruct-2503-FP8

Image-Text-to-Text • Updated Apr 17 • 3

RedHatAI/DeepSeek-R1-quantized.w4a16

Text Generation • Updated Apr 22 • 129 • 6

parasail-ai/Qwen2.5-VL-72B-Instruct-FP8-Dynamic

Image-Text-to-Text • Updated Apr 18 • 840 • 2

TeeZee/DeepHermes-3-Mistral-24B-Preview-bpw8.0-h8-exl2

Text Generation • Updated Apr 18 • 16

TeeZee/DeepHermes-3-Mistral-24B-Preview-bpw4.0-h8-exl2

Text Generation • Updated Apr 18 • 18 • 1

Lucy-in-the-Sky/Mistral-Small-24B-Instruct-2501-Q2_K-GGUF

Updated Apr 23 • 8

Lucy-in-the-Sky/Mistral-Small-24B-Instruct-2501-Q4_K_M-GGUF

Updated Apr 23 • 5

Lucy-in-the-Sky/Mistral-Small-24B-Instruct-2501-Q6_K-GGUF

Updated Apr 23 • 8

Lucy-in-the-Sky/Mistral-Small-24B-Instruct-2501-Q8_0-GGUF

Updated Apr 23 • 4

RedHatAI/Llama-4-Scout-17B-16E-Instruct-quantized.w4a16

Image-Text-to-Text • Updated 10 days ago • 6.15k • 6

RedHatAI/gemma-3-4b-it-FP8-dynamic

Image-Text-to-Text • Updated about 12 hours ago • 78

RedHatAI/gemma-3-12b-it-FP8-dynamic

Image-Text-to-Text • Updated about 12 hours ago • 86

RedHatAI/gemma-3-27b-it-FP8-dynamic

Image-Text-to-Text • Updated about 12 hours ago • 713

enferAI/Mistral-7B-Instruct-v0.3-FP8

Updated Apr 28 • 34

jacobcarajo/Mistral-Small-3.1-24B-Instruct-2503-Q5_K_M-GGUF

Image-Text-to-Text • Updated May 3 • 15

EliotShen/eliot-aicrowd-model

Image-Text-to-Text • Updated May 6

BCCard/gemma-3-27b-it-FP8-Dynamic

Image-Text-to-Text • Updated May 7 • 119 • 1

BCCard/gemma-3-12b-it-FP8-Dynamic

Image-Text-to-Text • Updated May 7 • 24 • 1