Edit Models filters

Apps

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Mixture of Experts

Carbon Emissions

Models

2,292

Full-text search

Active filters: 5-bit

MaziyarPanahi/VibeThinker-1.5B-GGUF

Text Generation • 2B • Updated 5 days ago • 15.2k • 35

MaziyarPanahi/BASH-Coder-Mistral-7B-Mistral-7B-Instruct-v0.2-slerp-GGUF

Text Generation • 7B • Updated Jan 26, 2024 • 346 • 5

MaziyarPanahi/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • 8B • Updated Jul 23, 2024 • 78.3k • 30

MaziyarPanahi/gemma-3-12b-it-GGUF

Text Generation • 12B • Updated Mar 12 • 152k • 12

MaziyarPanahi/BioMistral-7B-GGUF

Text Generation • 7B • Updated Feb 19, 2024 • 1.01k • 54

MaziyarPanahi/Bioxtral-4x7B-v0.1-GGUF

Text Generation • 24B • Updated Feb 20, 2024 • 91 • 3

MaziyarPanahi/Llama-3.3-70B-Instruct-GGUF

Text Generation • 71B • Updated Dec 7, 2024 • 77.5k • 19

MaziyarPanahi/Mistral-Small-24B-Instruct-2501-GGUF

Text Generation • 24B • Updated Jun 23 • 75.9k • 7

mlx-community/Qwen3-Next-80B-A3B-Instruct-5bit

Text Generation • 80B • Updated Sep 13 • 66 • 3

MaziyarPanahi/AesCoder-4B-GGUF

Text Generation • 4B • Updated 8 days ago • 176 • 1

MaziyarPanahi/Qwen3-4B-Thinking-2507-GGUF

Text Generation • 4B • Updated 5 days ago • 115 • 1

nightmedia/GLM-4.5-Air-Derestricted-qx53g-mlx

Text Generation • 107B • Updated about 19 hours ago • 121 • 1

nightmedia/GLM-4.5-Air-Derestricted-qx53gx-mlx

Text Generation • 107B • Updated about 22 hours ago • 54 • 1

LoneStriker/Yi-6B-200K-5.0bpw-h6-exl2

Text Generation • Updated Mar 16, 2024 • 1

MaziyarPanahi/phi-2-GGUF

Text Generation • 3B • Updated Jan 26, 2024 • 233 • 6

MaziyarPanahi/Tess-XS-v1-3-yarn-128K-Mistral-7B-Instruct-v0.1-GGUF

Text Generation • 7B • Updated Jan 26, 2024 • 93 • 6

MaziyarPanahi/zephyr-7b-beta-Mistral-7B-Instruct-v0.1-GGUF

Text Generation • 7B • Updated Jan 26, 2024 • 180 • 4

MaziyarPanahi/zephyr-7b-beta-Mistral-7B-Instruct-v0.2-GGUF

Text Generation • 7B • Updated Jan 30, 2024 • 193 • 5

MaziyarPanahi/NeuralPipe-7B-slerp-GGUF

Text Generation • 7B • Updated Jan 26, 2024 • 131 • 3

MaziyarPanahi/NeuralPipe-7B-slerp-v0.2-GGUF

Text Generation • 7B • Updated Jan 26, 2024 • 154 • 2

MaziyarPanahi/Mistral-7B-Instruct-v0.1-16k-Mistral-7B-Instruct-v0.2-slerp-GGUF

Text Generation • 7B • Updated Jan 26, 2024 • 143 • 2

MaziyarPanahi/rfp_instruct_model-Mistral-7B-Instruct-v0.2-slerp-GGUF

Text Generation • 7B • Updated Jan 26, 2024 • 86 • 2

MaziyarPanahi/Mistral-7B-Instruct-SQL-Mistral-7B-Instruct-v0.2-slerp-GGUF

Text Generation • 7B • Updated Jan 26, 2024 • 118 • 1

MaziyarPanahi/mistral-7B-Mistral-7B-Instruct-v0.2-slerp-GGUF

Text Generation • 7B • Updated Jan 26, 2024 • 165 • 1

MaziyarPanahi/tiledfloor-Mistral-7B-Instruct-v0.2-slerp-GGUF

Text Generation • 7B • Updated Jan 26, 2024 • 38 • 1

MaziyarPanahi/Mistral-11B-Instruct-v0.2-Mistral-7B-Instruct-v0.2-slerp-GGUF

Text Generation • 7B • Updated Jan 26, 2024 • 79 • 1

MaziyarPanahi/Commonsense-QA-Mistral-7B-Mistral-7B-Instruct-v0.2-slerp-GGUF

Text Generation • 7B • Updated Jan 26, 2024 • 105 • 1

MaziyarPanahi/finetuned-mistral-7b-Mistral-7B-Instruct-v0.2-slerp-GGUF

Text Generation • 7B • Updated Jan 26, 2024 • 47

MaziyarPanahi/Mistral-7B-Instruct-guidance-Mistral-7B-Instruct-v0.2-slerp-GGUF

Text Generation • 7B • Updated Jan 26, 2024 • 89

MaziyarPanahi/KAI-7B-Instruct-v0.1-Mistral-7B-Instruct-v0.2-slerp-GGUF

Text Generation • 7B • Updated Jan 26, 2024 • 78