Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Carbon Emissions

Misc with no match

4-bit precision

8-bit precision

text-embeddings-inference

Mixture of Experts

Models

144

Full-text search

Active filters: q5_k_m

afrideva/TinyLlama-haiku-dpo-v.0.1-GGUF

Text Generation • Updated Jan 19, 2024 • 53

afrideva/tinyllama-python-GGUF

Text Generation • Updated Jan 20, 2024 • 43

afrideva/phi-2-psy-GGUF

Text Generation • Updated Jan 20, 2024 • 93 • 6

afrideva/beecoder-220M-python-GGUF

Text Generation • Updated Jan 20, 2024 • 113

afrideva/smol_llama-220M-openhermes-GGUF

Text Generation • Updated Jan 20, 2024 • 153

afrideva/TinyLlama-3T-1.1bee-GGUF

Text Generation • Updated Jan 20, 2024 • 26 • 1

afrideva/smol_llama-220M-bees-internal-GGUF

Text Generation • Updated Jan 20, 2024 • 31

afrideva/smol_llama-220M-open_instruct-GGUF

Text Generation • Updated Jan 20, 2024 • 76

afrideva/zephyr-220m-sft-full-GGUF

Text Generation • Updated Jan 20, 2024 • 17

afrideva/zephyr-220m-dpo-full-GGUF

Text Generation • Updated Jan 20, 2024 • 74

afrideva/stablelm-2-1_6b-GGUF

Text Generation • Updated Jan 22, 2024 • 258 • 3

afrideva/stablelm-2-zephyr-1_6b-GGUF

Text Generation • Updated Jan 22, 2024 • 75 • 3

afrideva/LocutusqueXFelladrin-TinyMistral248M-Instruct_oasst2_chatML_V1_DPO_V3-GGUF

Text Generation • Updated Jan 27, 2024 • 49

afrideva/tau-0.5B-GGUF

Text Generation • Updated Mar 25, 2024 • 17

afrideva/tau-0.5B-instruct-GGUF

Text Generation • Updated Mar 25, 2024 • 51

afrideva/NeuralReyna-Mini-1.8B-v0.3-GGUF

Text Generation • Updated Mar 25, 2024 • 90 • 1

afrideva/gemma-1.1-2b-it_oasst_format_chatML_unsloth_V1_function_calling_V2-GGUF

Text Generation • Updated Apr 17, 2024 • 25 • 5

afrideva/Bioinspired-Phi-3-mini-4k-GGUF

Text Generation • Updated May 3, 2024 • 73

afrideva/Phi-3-mini-128k-instruct_function-GGUF

Text Generation • Updated May 8, 2024 • 84 • 1

afrideva/gemma-1.1-2b-it_orpo_traslate_en_es_V1-GGUF

Text Generation • Updated May 10, 2024 • 29

yqnis/llama3-8b-quaero-gguf

Updated Apr 10 • 2

Deaquay/T-Rex-mini-I1-GGUF

Updated Apr 9 • 134

yqnis/mistral-7b-quaero-gguf

Updated Apr 11 • 3

tifin-india/sarvam-m-24b-q5-k-m-gguf

Text Generation • Updated 19 days ago • 229 • 2