Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

AutoTrain Compatible

Mixture of Experts

8-bit precision

Carbon Emissions

text-embeddings-inference

Models

18,112

Full-text search

Active filters: llama-cpp

itayl/omost-llama-3-8b-Q5_K_M-GGUF

Updated Jun 6, 2024 • 4

Ransss/EstopianMaid-13B-Q6_K-GGUF

Updated Jun 6, 2024 • 7

NikolayKozloff/Qwen2-7B-Q8_0-GGUF

Text Generation • Updated Jun 6, 2024 • 16 • 2

v000000/MysticGem-v1.3-L2-13B-Q4_K_M-GGUF

Updated Jun 6, 2024 • 3

NikolayKozloff/Qwen2-7B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Jun 6, 2024 • 7 • 5

NikolayKozloff/Qwen2-7B-Instruct-Q5_K_S-GGUF

Text Generation • Updated Jun 6, 2024 • 17 • 1

NikolayKozloff/Qwen2-7B-Instruct-Q4_0-GGUF

Text Generation • Updated Jun 6, 2024 • 13 • 1

NikolayKozloff/Qwen2-7B-Q6_K-GGUF

Text Generation • Updated Jun 6, 2024 • 677 • 1

NikolayKozloff/Qwen2-7B-Q5_K_M-GGUF

Text Generation • Updated Jun 6, 2024 • 6 • 2

NikolayKozloff/Qwen2-7B-Q5_K_S-GGUF

Text Generation • Updated Jun 6, 2024 • 14 • 1

NikolayKozloff/Qwen2-7B-Q4_K_M-GGUF

Text Generation • Updated Jun 6, 2024 • 49 • 1

NikolayKozloff/Qwen2-7B-Q4_K_S-GGUF

Text Generation • Updated Jun 6, 2024 • 6 • 1

NikolayKozloff/Qwen2-7B-Q4_0-GGUF

Text Generation • Updated Jun 6, 2024 • 11 • 1

NikolayKozloff/Qwen2-7B-Q5_0-GGUF

Text Generation • Updated Jun 6, 2024 • 13 • 1

v000000/MysticGem-v1.3-L2-13B-Q4_K_S-GGUF

Updated Jun 6, 2024 • 3

SeacomSrl/SeaQwen2-0.5B-Q4_K_M-GGUF

Updated Jun 6, 2024 • 11

Dragon808/Meta-Llama-3-8B-Q4_K_M-GGUF

Text Generation • Updated Jun 6, 2024 • 4

powermove72/Notus-TheTop-7b-Passthrough-Q4_K_M-GGUF

Updated Jun 7, 2024 • 2

andreasmartin/Mistral-7B-Instruct-gender-bias-dpo-Q4_K_M-GGUF

Text Generation • Updated Jun 7, 2024 • 20

newsletter/Llama3-DiscoLeo-Instruct-8B-32k-v0.1-Q6_K-GGUF

Updated Jun 7, 2024 • 2

newsletter/Llama3-DiscoLeo-Instruct-8B-v0.1-Q6_K-GGUF

Updated Jun 7, 2024 • 2

andreasmartin/Mistral-7B-Instruct-gender-bias-sft-Q4_K_M-GGUF

Text Generation • Updated Jun 7, 2024 • 5

SeacomSrl/SeaQwen2-1.5B-Q4_K_M-GGUF

Updated Jun 7, 2024 • 9

zz814/Qwen2-1.5B-Instruct-Q8_0-GGUF

Text Generation • Updated Jun 7, 2024 • 3

ygaci/avispqp_tinyllama_lora_nf4_merged_2-Q4_K_M-GGUF

Updated Jun 7, 2024 • 20

ygaci/avispqp_tinyllama_lora_nf4_merged_2-Q8_0-GGUF

Updated Jun 7, 2024 • 16

NikolayKozloff/L3-Aethora-15B-Q5_K_S-GGUF

Updated Jun 7, 2024 • 2 • 1

NikolayKozloff/L3-Aethora-15B-Q4_K_S-GGUF

Updated Jun 7, 2024 • 2 • 1

NikolayKozloff/L3-Aethora-15B-Q5_K_M-GGUF

Updated Jun 7, 2024 • 14 • 1

shajmaan/Qwen2-7B-Instruct-Q4_0-GGUF

Text Generation • Updated Jun 7, 2024 • 2