Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

3,506

Full-text search

Active filters: chat

MERaLiON/MERaLiON-AudioLLM-Whisper-SEA-LION

Automatic Speech Recognition • Updated 22 days ago • 1.06k • 6

unsloth/QwQ-32B-Preview-unsloth-bnb-4bit

Text Generation • Updated Dec 6, 2024 • 946 • 17

QuantFactory/phi-4-GGUF

Text Generation • Updated 9 days ago • 1.14k • 2

mradermacher/phi-4-abliterated-i1-GGUF

Updated 9 days ago • 1.93k • 3

maldv/Qwenstein2.5-32B-Instruct

Text Generation • Updated 4 days ago • 62 • 2

Pinkstack/SuperThoughts-CoT-14B-16k-o1-QwQ

Text Generation • Updated about 14 hours ago • 14 • 2

mradermacher/L3.3-70B-Magnum-v4-SE-i1-GGUF

Updated 13 minutes ago • 2

Qwen/Qwen1.5-72B-Chat

Text Generation • Updated Oct 8, 2024 • 5.59k • 217

MarsupialAI/KitchenSink_103b_iMatrix_GGUF

Updated May 11, 2024 • 11 • 1

Qwen/CodeQwen1.5-7B-Chat

Text Generation • Updated Apr 30, 2024 • 76.3k • 318

wdndev/tiny_llm_sft_92m

Text Generation • Updated May 27, 2024 • 32 • 2

Qwen/Qwen2-0.5B-Instruct

Text Generation • Updated Aug 21, 2024 • 132k • 170

Qwen/Qwen2-57B-A14B-Instruct

Text Generation • Updated Aug 21, 2024 • 6.61k • 79

Qwen/Qwen2-7B-Instruct-AWQ

Text Generation • Updated Aug 21, 2024 • 748 • 20

Qwen/Qwen2-0.5B-Instruct-GGUF

Text Generation • Updated Aug 21, 2024 • 9.18k • 61

anthracite-org/magnum-v1-72b

Text Generation • Updated Sep 29, 2024 • 4.91k • 163

internlm/internlm2_5-7b-chat-gguf

Text Generation • Updated Jul 16, 2024 • 1.42k • 76

pek111/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • Updated Jul 26, 2024 • 198 • 7

anthracite-org/magnum-v2-12b

Text Generation • Updated Sep 14, 2024 • 937 • 82

anthracite-org/magnum-v2-12b-gguf

Text Generation • Updated Aug 22, 2024 • 3.29k • 34

anthracite-org/magnum-v2.5-12b-kto

Text Generation • Updated Aug 22, 2024 • 4.9k • 46

hellork/calme-2.1-qwen2-7b-Q4_K_M-GGUF

Text Generation • Updated Sep 17, 2024 • 2

YorkieOH10/Hermes-3-Llama-3.1-8B-Q8_0-GGUF

Updated Aug 15, 2024 • 1 • 1

bartowski/Hermes-3-Llama-3.1-8B-GGUF

Text Generation • Updated Aug 16, 2024 • 743 • 7

LoneStriker/Hermes-3-Llama-3.1-8B-3.0bpw-h6-exl2

Updated Aug 15, 2024 • 5 • 1

LoneStriker/Hermes-3-Llama-3.1-8B-4.0bpw-h6-exl2

Updated Aug 15, 2024 • 8 • 1

LoneStriker/Hermes-3-Llama-3.1-8B-5.0bpw-h6-exl2

Updated Aug 15, 2024 • 4 • 2

LoneStriker/Hermes-3-Llama-3.1-8B-6.0bpw-h6-exl2

Updated Aug 15, 2024 • 9 • 2

LoneStriker/Hermes-3-Llama-3.1-8B-GGUF

Updated Aug 15, 2024 • 36 • 2

LoneStriker/Hermes-3-Llama-3.1-8B-8.0bpw-h8-exl2

Updated Aug 15, 2024 • 9 • 1