Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

2,466

Full-text search

Active filters: 3-bit

MaziyarPanahi/MT-Merge6-gemma-2-9B-GGUF

Text Generation • Updated 26 days ago • 687 • 1

MaziyarPanahi/UIGEN-7B-16bit-GGUF

Text Generation • Updated 24 days ago • 237 • 1

MaziyarPanahi/Ayla-Light-12B-v2-GGUF

Text Generation • Updated 24 days ago • 295 • 1

mlx-community/Wayfarer-Large-70B-Llama-3.3-3bit

Text Generation • Updated 20 days ago • 15 • 1

MaziyarPanahi/SmolLM2-1.7B-Instruct-16k-GGUF

Text Generation • Updated 19 days ago • 170 • 1

MaziyarPanahi/ALLaM-7B-Instruct-preview-reasoning-GGUF

Text Generation • Updated 19 days ago • 407 • 1

MaziyarPanahi/Lamarck-14B-v0.7-Fusion-GGUF

Text Generation • Updated 17 days ago • 518 • 1

MaziyarPanahi/Viper-Coder-HybridMini-v1.3-GGUF

Text Generation • Updated 17 days ago • 510 • 1

MaziyarPanahi/DeepSeek-R1-Distill-Llama-3B-GGUF

Text Generation • Updated 16 days ago • 752 • 1

Jellon/Wayfarer-Large-70B-Llama-3.3-exl2-3bpw

Text Generation • Updated 15 days ago • 22 • 1

MaziyarPanahi/Primal-Opus-14B-Optimus-v2-GGUF

Text Generation • Updated 12 days ago • 183 • 1

MaziyarPanahi/Phi-4-mini-instruct-GGUF

Text Generation • Updated 12 days ago • 589k • 3

MaziyarPanahi/QwQ-32B-GGUF

Text Generation • Updated 6 days ago • 292k • 1

MaziyarPanahi/Qwen-1M-DeepSeek-R1-14B-GGUF

Text Generation • Updated 4 days ago • 250 • 1

MaziyarPanahi/Deductive-Reasoning-Qwen-32B-GGUF

Text Generation • Updated 1 day ago • 285 • 1

MaziyarPanahi/Deductive-Reasoning-Qwen-14B-GGUF

Text Generation • Updated 1 day ago • 288 • 1

MaziyarPanahi/gemma-3-1b-it-GGUF

Text Generation • Updated about 5 hours ago • 1

MaziyarPanahi/gemma-3-4b-it-GGUF

Text Generation • Updated about 5 hours ago • 1

MaziyarPanahi/gemma-3-12b-it-GGUF

Text Generation • Updated about 5 hours ago • 1

ReadyArt/Forgotten-Safeword-22B_EXL2_3bpw_H8

Updated 25 days ago • 9 • 1

ReadyArt/Forgotten-Safeword-v1.1-22B_EXL2_3bpw_H8

Updated 22 days ago • 24 • 1

rirv938/GPTQ-LLaMa-65B-4bit-triton

Text Generation • Updated May 25, 2023 • 9

kaitchup/Llama-2-7b-gptq-3bit

Text Generation • Updated Sep 9, 2023 • 18

clibrain/Llama-2-7b-ft-instruct-es-gptq-3bit

Text Generation • Updated Sep 20, 2023 • 18 • 3

clibrain/Llama-2-13b-ft-instruct-es-gptq-3bit

Text Generation • Updated Sep 20, 2023 • 21 • 3

MiNeves-TensorOps/opt-125m-gptq-3bit

Text Generation • Updated Sep 25, 2023 • 12

Kimata/opt-125m-3bit

Text Generation • Updated Sep 29, 2023 • 14

LoneStriker/Yi-6B-200K-3.0bpw-h6-exl2

Text Generation • Updated Mar 16, 2024 • 9

danny0122/Llama-2-7b-hf-gptq-3bits

Text Generation • Updated Dec 11, 2023 • 79

danny0122/Llama-2-7b-hf-gptq-3bitssafe

Text Generation • Updated Dec 11, 2023 • 77