Edit Models filters

Misc

4-bit precision

8-bit precision

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Models

1,952

Full-text search

Active filters: quantized

afrideva/GPT-NeoX-1.3B-viet-final-GGUF

Text Generation • Updated Nov 9, 2023 • 74 • 1

afrideva/Tiny-Vicuna-1B-GGUF

Text Generation • Updated Nov 23, 2023 • 45.2k • 4

afrideva/phi-2-uncensored-GGUF

Text Generation • Updated Dec 21, 2023 • 10.1k • 9

Lewdiculous/Kunoichi-DPO-v2-7B-GGUF-Imatrix

Text Generation • Updated May 4, 2024 • 4.98k • 38

MaziyarPanahi/Mistral-7B-Instruct-Aya-101-GGUF

Text Generation • Updated Feb 28, 2024 • 148 • 8

Lewdiculous/LemonadeRP-4.5.3-GGUF-IQ-Imatrix

Updated Mar 14, 2024 • 113 • 13

MaziyarPanahi/Mixtral-8x22B-v0.1-GGUF

Text Generation • Updated Apr 15, 2024 • 1.25M • 73

Lewdiculous/Nyanade_Stunna-Maid-7B-GGUF-IQ-Imatrix

Updated Apr 14, 2024 • 160 • 11

Lewdiculous/Nyanade_Stunna-Maid-7B-v0.2-GGUF-IQ-Imatrix

Updated May 4, 2024 • 2.05k • 51

MaziyarPanahi/WizardLM-2-7B-GGUF

Text Generation • Updated Apr 15, 2024 • 1.56M • 75

MaziyarPanahi/WizardLM-2-8x22B-GGUF

Text Generation • Updated Apr 16, 2024 • 56.5k • 126

MaziyarPanahi/Meta-Llama-3-8B-Instruct-GGUF

Text Generation • Updated Apr 23, 2024 • 1.68M • 84

astronomer/Llama-3-8B-Instruct-GPTQ-4-Bit

Text Generation • Updated Apr 22, 2024 • 10.5k • 25

afrideva/Tinystories-gpt-0.1-3m-GGUF

Text Generation • Updated May 12, 2024 • 134 • 3

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • Updated May 22, 2024 • 1.65M • 76

qualcomm/Stable-Diffusion-v2.1

Unconditional Image Generation • Updated 7 days ago • 12

MaziyarPanahi/Qwen2-7B-Instruct-GGUF

Text Generation • Updated Jun 6, 2024 • 1.53M • 11

MaziyarPanahi/firefunction-v2-GGUF

Text Generation • Updated Jun 20, 2024 • 1.53M • 16

legraphista/glm-4-9b-chat-IMat-GGUF

Text Generation • Updated Jun 20, 2024 • 347 • 5

legraphista/glm-4-9b-chat-GGUF

Text Generation • Updated Jun 20, 2024 • 1.24k • 20

MaziyarPanahi/Mistral-Nemo-Instruct-2407-GGUF

Text Generation • Updated Jul 22, 2024 • 1.55M • 40

MaziyarPanahi/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • Updated Jul 23, 2024 • 1.51M • 15

pek111/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • Updated Jul 26, 2024 • 301 • 7

legraphista/Hermes-3-Llama-3.1-8B-IMat-GGUF

Text Generation • Updated Aug 16, 2024 • 325 • 1

legraphista/Hermes-3-Llama-3.1-70B-IMat-GGUF

Text Generation • Updated Aug 16, 2024 • 192 • 1

legraphista/c4ai-command-r-plus-08-2024-IMat-GGUF

Text Generation • Updated Aug 31, 2024 • 108 • 6

MaziyarPanahi/Yi-Coder-1.5B-Chat-GGUF

Text Generation • Updated Sep 4, 2024 • 1.51M • 5

MaziyarPanahi/solar-pro-preview-instruct-GGUF

Text Generation • Updated Sep 13, 2024 • 1.51M • 24

MaziyarPanahi/Qwen2.5-1.5B-Instruct-GGUF

Text Generation • Updated Sep 18, 2024 • 1.5M • 3

MaziyarPanahi/Qwen2.5-7B-Instruct-GGUF

Text Generation • Updated Sep 18, 2024 • 1.52M • 9