Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

8-bit precision

4-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

text-embeddings-inference

Mixture of Experts

Carbon Emissions

Models

37,305

Full-text search

Active filters: bitsandbytes

ashishkgpian/BioLlama3

Text Generation • Updated Jul 30, 2024 • 8 • 1

unsloth/gemma-2-2b-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 13.6k • 10

unsloth/gemma-2-2b-it-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 11.9k • 17

HelpMumHQ/MamaBot-Llama

Text Generation • Updated Sep 10, 2024 • 201 • 3

openbmb/MiniCPM-V-2_6-int4

Image-Text-to-Text • Updated Feb 27 • 115k • 76

mlconvexai/jais-13b-chat_bitsandbytes_8bit

Text Generation • Updated Oct 27, 2024 • 50 • 1

unsloth/Qwen2-Math-1.5B-bnb-4bit

Text Generation • Updated Aug 8, 2024 • 7 • 1

unsloth/Qwen2-Math-7B-Instruct-bnb-4bit

Text Generation • Updated Aug 8, 2024 • 8 • 1

unsloth/Qwen2-Math-7B-bnb-4bit

Text Generation • Updated Aug 8, 2024 • 10 • 1

unsloth/Qwen2-Math-1.5B-Instruct-bnb-4bit

Text Generation • Updated Aug 8, 2024 • 7 • 1

Sergei6000/Qwen2-Audio-7B-Instruct-Int4

Updated Aug 10, 2024 • 610 • 6

PrunaAI/IlyaGusev-gemma-2-2b-it-abliterated-bnb-4bit-smashed

Updated Aug 14, 2024 • 375 • 1

informatiker/Hermes-3-Llama-3.1-8B-4bit

Updated Aug 15, 2024 • 9 • 2

PrunaAI/OuteAI-Lite-Oute-1-300M-Instruct-bnb-4bit-smashed

Updated Aug 16, 2024 • 7 • 1

PrunaAI/Writer-palmyra-base-bnb-4bit-smashed

Updated Aug 20, 2024 • 7 • 1

unsloth/Phi-3.5-mini-instruct-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 13.9k • 13

alicekyting/Qwen2-Audio-7B-Instruct-4bit

Text2Text Generation • Updated Aug 22, 2024 • 193k • 5

ms57rd/Llama-3.1-8B-quantized-EEG-TimeLLM

Updated Aug 25, 2024 • 14 • 11

ICEPVP8977/Uncensored_Phi_3_mini_128k_Safetensors_4b

Updated 27 days ago • 48 • 1

unsloth/c4ai-command-r-08-2024-bnb-4bit

Text Generation • Updated Dec 16, 2024 • 358 • 9

sayakpaul/flux.1-dev-nf4-with-bnb-integration

Updated Sep 1, 2024 • 73 • 16

watsonchua/hansard-gemma-2-9b-lora

Updated Sep 2, 2024 • 2 • 1

illuin/llama-3-grouse

Text Generation • Updated Sep 17, 2024 • 1 • 1

unsloth/Hermes-3-Llama-3.1-8B-bnb-4bit

Text Generation • Updated Sep 4, 2024 • 345 • 5

unsloth/Llama-3.1-Storm-8B-bnb-4bit

Text Generation • Updated Sep 4, 2024 • 382 • 7

unsloth/c4ai-command-r-plus-08-2024-bnb-4bit

Text Generation • Updated Dec 16, 2024 • 27 • 3

unsloth/Hermes-3-Llama-3.1-70B-bnb-4bit

Text Generation • Updated Sep 4, 2024 • 59 • 1

unsloth/Meta-Llama-3.1-405B-Instruct-bnb-4bit

Text Generation • Updated Sep 11, 2024 • 291 • 6

Stratos-Kakalis/complete-SPARQL-tuned-mistral

Text Generation • Updated Sep 4, 2024 • 12 • 1

axolotl-quants/DeepSeek-V2.5-bnb-nf4-bf16

Updated Sep 12, 2024 • 281 • 2