Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

8-bit precision

4-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

719

Full-text search

Active filters: vllm

BCCard/gemma-3-4b-it-FP8-Dynamic

Image-Text-to-Text • Updated May 7 • 124 • 2

ReadyArt/Mistral-Small-3.1-24B-Instruct-2503_EXL2_2.5bpw_H8

Updated May 7 • 9

ReadyArt/Mistral-Small-3.1-24B-Instruct-2503_EXL2_3.7bpw_H8

Updated May 7 • 9

ReadyArt/Mistral-Small-3.1-24B-Instruct-2503_EXL2_4.0bpw_H8

Updated May 7 • 5

ReadyArt/Mistral-Small-3.1-24B-Instruct-2503_EXL2_5.0bpw_H8

Updated May 7 • 11

ReadyArt/Mistral-Small-3.1-24B-Instruct-2503_EXL2_6.0bpw_H8

Updated May 7 • 12

ReadyArt/Mistral-Small-3.1-24B-Instruct-2503_EXL2_8.0bpw_H8

Updated May 7 • 16 • 1

BCCard/Qwen2.5-VL-32B-Instruct-FP8-Dynamic

Image-Text-to-Text • Updated May 9 • 18

BCCard/Qwen2.5-VL-72B-Instruct-FP8-Dynamic

Image-Text-to-Text • Updated May 9 • 10

vegeta03/DeepHermes-3-Llama-3-8B-Preview-Q8_0-GGUF

Updated May 9 • 6

RedHatAI/Mistral-Small-3.1-24B-Instruct-2503

Image-Text-to-Text • Updated 10 days ago • 65

RedHatAI/Mistral-Small-24B-Instruct-2501

Text Generation • Updated 10 days ago • 180

drensin/DeepHermes-3-Llama-3-8B-Preview-Q8_0-GGUF

Updated 30 days ago • 24

jsbaicenter/r1-1776-distill-llama-70b-GPTQ-4bit

Text Generation • Updated 28 days ago • 9

enosislabs/math-mini-1.7b-preview-16bits

Text Generation • Updated 16 days ago • 31

chutesai/Devstral-Small-2505

Text2Text Generation • Updated 19 days ago • 353

reach-vb/Devstral-Small-2505

Text2Text Generation • Updated 19 days ago • 38

guysh-dev/Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M-GGUF

Image-Text-to-Text • Updated 19 days ago • 37

unsloth/Devstral-Small-2505-unsloth-bnb-4bit

Text2Text Generation • Updated 16 days ago • 2.23k • 4

Abdoul-AI/Devstral-Small-2505-GGUF

Text2Text Generation • Updated 19 days ago

matatonic/Devstral-Small-2505-4.25bpw-exl2

Text2Text Generation • Updated 19 days ago • 102 • 2

matatonic/Devstral-Small-2505-5.0bpw-exl2

Text2Text Generation • Updated 19 days ago • 51 • 1

matatonic/Devstral-Small-2505-6.5bpw-h8-exl2

Text2Text Generation • Updated 19 days ago • 57 • 1

lucyknada/unsloth_Devstral-Small-2505-exl3

Text2Text Generation • Updated 19 days ago • 5

ArtusDev/mistralai_Devstral-Small-2505_EXL3_3.0bpw_H6

Text2Text Generation • Updated 19 days ago • 57

ArtusDev/mistralai_Devstral-Small-2505_EXL3_3.5bpw_H6

Text2Text Generation • Updated 19 days ago • 18

ArtusDev/mistralai_Devstral-Small-2505_EXL3_4.0bpw_H6

Text2Text Generation • Updated 19 days ago • 58 • 1

ArtusDev/mistralai_Devstral-Small-2505_EXL3_4.5bpw_H6

Text2Text Generation • Updated 19 days ago • 20

ArtusDev/mistralai_Devstral-Small-2505_EXL3_5.0bpw_H6

Text2Text Generation • Updated 19 days ago • 34

ArtusDev/mistralai_Devstral-Small-2505_EXL3_6.0bpw_H6

Text2Text Generation • Updated 19 days ago • 81