Edit Models filters

Inference status

Misc

4-bit precision

8-bit precision

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Models

1,935

Full-text search

Active filters: quantized

MaziyarPanahi/Meta-Llama-3-8B-Instruct-GGUF

Text Generation • Updated Apr 23, 2024 • 1.94M • 83

argmaxinc/whisperkit-coreml

Automatic Speech Recognition • Updated 4 days ago • 84.6k • 103

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • Updated May 22, 2024 • 1.92M • 74

MaziyarPanahi/Llama-3.3-70B-Instruct-GGUF

Text Generation • Updated Dec 7, 2024 • 1.38M • 10

MaziyarPanahi/Qwen2.5-Coder-0.5B-QwQ-draft-GGUF

Text Generation • Updated 11 days ago • 390 • 3

Lewdiculous/LemonadeRP-4.5.3-GGUF-IQ-Imatrix

Updated Mar 14, 2024 • 103 • 13

MaziyarPanahi/Mixtral-8x22B-v0.1-GGUF

Text Generation • Updated Apr 15, 2024 • 1.11M • 74

Lewdiculous/Nyanade_Stunna-Maid-7B-GGUF-IQ-Imatrix

Updated Apr 14, 2024 • 128 • 11

Lewdiculous/Nyanade_Stunna-Maid-7B-v0.2-GGUF-IQ-Imatrix

Updated May 4, 2024 • 1.84k • 48

MaziyarPanahi/WizardLM-2-7B-GGUF

Text Generation • Updated Apr 15, 2024 • 1.86M • 75

MaziyarPanahi/WizardLM-2-8x22B-GGUF

Text Generation • Updated Apr 16, 2024 • 34.8k • 126

astronomer/Llama-3-8B-Instruct-GPTQ-4-Bit

Text Generation • Updated Apr 22, 2024 • 6.83k • 25

qualcomm/Stable-Diffusion-v2.1

Unconditional Image Generation • Updated 9 days ago • 11

MaziyarPanahi/Qwen2-7B-Instruct-GGUF

Text Generation • Updated Jun 6, 2024 • 1.84M • 11

MaziyarPanahi/firefunction-v2-GGUF

Text Generation • Updated Jun 20, 2024 • 1.83M • 16

legraphista/glm-4-9b-chat-IMat-GGUF

Text Generation • Updated Jun 20, 2024 • 310 • 5

legraphista/glm-4-9b-chat-GGUF

Text Generation • Updated Jun 20, 2024 • 955 • 20

MaziyarPanahi/Mistral-Nemo-Instruct-2407-GGUF

Text Generation • Updated Jul 22, 2024 • 1.89M • 40

MaziyarPanahi/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • Updated Jul 23, 2024 • 1.83M • 15

pek111/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • Updated Jul 26, 2024 • 198 • 7

legraphista/Hermes-3-Llama-3.1-8B-IMat-GGUF

Text Generation • Updated Aug 16, 2024 • 286 • 1

legraphista/Hermes-3-Llama-3.1-70B-IMat-GGUF

Text Generation • Updated Aug 16, 2024 • 129 • 1

legraphista/c4ai-command-r-plus-08-2024-IMat-GGUF

Text Generation • Updated Aug 31, 2024 • 95 • 6

MaziyarPanahi/solar-pro-preview-instruct-GGUF

Text Generation • Updated Sep 13, 2024 • 1.83M • 24

MaziyarPanahi/Qwen2.5-7B-Instruct-GGUF

Text Generation • Updated Sep 18, 2024 • 1.84M • 9

MaziyarPanahi/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Sep 25, 2024 • 1.41M • 9

MaziyarPanahi/Llama-3.2-1B-Instruct-GGUF

Text Generation • Updated Sep 25, 2024 • 1.84M • 7

qualcomm/PLaMo-1B

Text Generation • Updated 9 days ago • 1

MaziyarPanahi/Llama-3.2-1B-GGUF

Text Generation • Updated Nov 2, 2024 • 68 • 1

MaziyarPanahi/patricide-12B-Unslop-Mell-v2-GGUF

Text Generation • Updated Dec 16, 2024 • 198 • 3