Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

8-bit precision

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Models

2,182

Full-text search

Active filters: quantized

Lewdiculous/Kunoichi-DPO-v2-7B-GGUF-Imatrix

Text Generation • Updated May 4, 2024 • 3.48k • 39

MaziyarPanahi/Meta-Llama-3-8B-Instruct-GGUF

Text Generation • Updated Apr 23, 2024 • 945k • 88

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • Updated May 22, 2024 • 919k • 91

MaziyarPanahi/Mistral-Nemo-Instruct-2407-GGUF

Text Generation • Updated Jul 22, 2024 • 820k • 43

MaziyarPanahi/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • Updated Jul 23, 2024 • 819k • 19

MaziyarPanahi/QwQ-32B-GGUF

Text Generation • Updated Mar 7 • 562k • 3

MaziyarPanahi/gemma-3-27b-it-GGUF

Text Generation • Updated 28 days ago • 466k • 4

afrideva/GPT-NeoX-1.3B-viet-final-GGUF

Text Generation • Updated Nov 9, 2023 • 135 • 1

afrideva/TinyLlama-1.1B-Chat-v0.6-GGUF

Text Generation • Updated Nov 20, 2023 • 130 • 9

afrideva/Tiny-Vicuna-1B-GGUF

Text Generation • Updated Nov 23, 2023 • 34.2k • 4

afrideva/phi-2-uncensored-GGUF

Text Generation • Updated Dec 21, 2023 • 1.72k • 9

afrideva/Llama-68M-Chat-v1-GGUF

Text Generation • Updated Jan 17, 2024 • 92 • 2

MaziyarPanahi/SauerkrautLM-7b-HerO-Mistral-7B-Instruct-v0.1-GGUF

Text Generation • Updated Jan 29, 2024 • 85 • 2

MaziyarPanahi/Mixtral-8x7B-v0.1-GGUF

Text Generation • Updated Feb 4, 2024 • 125 • 1

MaziyarPanahi/rank_zephyr_7b_v1_full-GGUF

Text Ranking • Updated 11 days ago • 516 • 5

MaziyarPanahi/OPEN-SOLAR-KO-10.7B-GGUF

Text Generation • Updated Feb 4, 2024 • 67 • 1

MaziyarPanahi/sqlcoder-7b-2-GGUF

Text Generation • Updated Feb 13, 2024 • 296 • 10

MaziyarPanahi/BioMistral-7B-GGUF

Text Generation • Updated Feb 19, 2024 • 1.08k • 51

MaziyarPanahi/gemma-2b-it-GGUF

Text Generation • Updated Feb 27, 2024 • 604 • 10

solidrust/Nous-Hermes-2-Mistral-7B-DPO-AWQ

Text Generation • Updated Sep 3, 2024 • 17 • 8

qualcomm/Stable-Diffusion

Unconditional Image Generation • Updated Apr 30, 2024 • 24

MaziyarPanahi/LongAlpaca-13B-GGUF

Text Generation • Updated Feb 26, 2024 • 227 • 3

Lewdiculous/Prodigy_7B-GGUF-Imatrix

Text Generation • Updated Feb 27, 2024 • 86 • 7

Lewdiculous/Loyal-Toppy-Bruins-Maid-7B-DARE-GGUF-Imatrix

Text Generation • Updated Feb 27, 2024 • 221 • 15

argmaxinc/whisperkit-coreml

Automatic Speech Recognition • Updated about 4 hours ago • 312k • 123

MaziyarPanahi/Mistral-7B-Instruct-Aya-101-GGUF

Text Generation • Updated Feb 28, 2024 • 183 • 8

AetherArchitectural/GGUF-Quantization-Script

Text Generation • Updated Dec 18, 2024 • 64

Lewdiculous/mistral-7b-v0.1-layla-v4-GGUF-IQ-Imatrix

Text Generation • Updated Mar 3, 2024 • 295 • 8

solidrust/OpenHercules-2.5-Mistral-7B-AWQ

Text Generation • Updated Sep 3, 2024 • 12 • 1

Lewdiculous/Datura_7B-GGUF-Imatrix

Updated Mar 8, 2024 • 33 • 6