Edit Models filters

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

8-bit precision

4-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

242

Full-text search

Active filters: vllm

mistralai/Ministral-8B-Instruct-2410

Updated Dec 6, 2024 • 1.31M • 408

mistralai/Pixtral-12B-2409

Image-Text-to-Text • Updated Dec 26, 2024 • 590

mistralai/Mistral-Large-Instruct-2411

Updated Nov 19, 2024 • 1.28M • 196

neuralmagic-ent/Llama-3.3-70B-Instruct-quantized.w8a8

Text Generation • Updated 7 days ago • 336 • 2

neuralmagic/Meta-Llama-3-8B-Instruct-FP8

Text Generation • Updated Jul 18, 2024 • 12k • 20

neuralmagic/Meta-Llama-3-8B-Instruct-FP8-KV

Text Generation • Updated Jun 19, 2024 • 4.92k • 7

neuralmagic/Qwen2-72B-Instruct-FP8

Text Generation • Updated Jul 18, 2024 • 567 • 12

neuralmagic/Meta-Llama-3.1-70B-Instruct-FP8-dynamic

Text Generation • Updated Oct 19, 2024 • 1.84k • 6

neuralmagic/Meta-Llama-3.1-70B-Instruct-FP8

Text Generation • Updated Oct 9, 2024 • 57.2k • 38

neuralmagic/Meta-Llama-3.1-8B-Instruct-quantized.w8a8

Text Generation • Updated Oct 23, 2024 • 4.42k • 14

mistralai/Mistral-Large-Instruct-2407

Updated Oct 16, 2024 • 1.27M • 818

neuralmagic/Meta-Llama-3.1-70B-Instruct-quantized.w8a8

Text Generation • Updated Oct 10, 2024 • 9.46k • 19

neuralmagic/Meta-Llama-3.1-70B-Instruct-quantized.w4a16

Text Generation • Updated Oct 10, 2024 • 19.6k • 29

mradermacher/nemotron-3-8b-chat-4k-sft-hf-i1-GGUF

Updated Aug 16, 2024 • 132 • 3

mistralai/Mistral-Small-Instruct-2409

Updated Oct 16, 2024 • 1.29M • 372

neuralmagic/Llama-3.2-11B-Vision-Instruct-FP8-dynamic

Text Generation • Updated Oct 2, 2024 • 6.86k • 20

mistralai/Pixtral-12B-Base-2409

Updated Oct 30, 2024 • 72

mistralai/Pixtral-Large-Instruct-2411

Image-Text-to-Text • Updated Dec 26, 2024 • 4 • 392

bullerwins/Mistral-Large-Instruct-2411-exl2_3.0bpw

Updated Nov 20, 2024 • 4 • 1

neuralmagic/Sparse-Llama-3.1-8B-2of4

Text Generation • Updated Dec 16, 2024 • 896 • 61

ZeroXClem/L3-Aspire-Heart-Matrix-8B

Text Generation • Updated Nov 24, 2024 • 31 • 4

neuralmagic/Sparse-Llama-3.1-8B-evolcodealpaca-2of4

Text Generation • Updated Nov 21, 2024 • 23 • 1

MERaLiON/MERaLiON-AudioLLM-Whisper-SEA-LION

Automatic Speech Recognition • Updated 9 days ago • 1.71k • 8

DBMe/Mistral-Large-Instruct-2411-2.86bpw-h6-exl2

Updated Nov 23, 2024 • 4 • 1

jacobcarajo/Ministral-8B-Instruct-2410-Q5_K_M-GGUF

Updated Dec 14, 2024 • 44 • 1

redhat6/Ministral-8B-Instruct-2410-Q8_0-GGUF

Updated Dec 23, 2024 • 14 • 1

nintwentydo/pixtral-12b-FP8-dynamic-FP8-KV-cache

Image-Text-to-Text • Updated 24 days ago • 134 • 1

matrixportal/Ministral-8B-Instruct-2410-Q4_K_M-GGUF

Updated 27 days ago • 22 • 1

nintwentydo/pixtral-12b-2409-2of4-sparse

Image-Text-to-Text • Updated 24 days ago • 96 • 1

nintwentydo/pixtral-12b-2409-W4A16-G128

Image-Text-to-Text • Updated 24 days ago • 329 • 1