Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

8-bit precision

4-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

text-embeddings-inference

Mixture of Experts

Carbon Emissions

Models

37,305

Full-text search

Active filters: bitsandbytes

unsloth/Qwen2-7B-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 1.87k • 4

unsloth/Qwen2-7B-Instruct-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 3.31k • 6

unsloth/Qwen2-72B-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 78 • 4

unsloth/Qwen2-1.5B-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 1.63k • 6

nikravan/glm-4vq

Document Question Answering • Updated Jun 16, 2024 • 533 • 33

PrunaAI/GreatCaptainNemo-ProLLaMA-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 15 • 1

PrunaAI/llmware-bling-phi-3-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 7 • 1

Tom158/Llama3_8B-Inst_NutritionAI

Text Generation • Updated Jun 21, 2024 • 102 • 1

ASSERT-KTH/FLAMES-100k

Text Generation • Updated Jun 26, 2024 • 40 • 1

unsloth/gemma-2-9b-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 26.4k • 27

unsloth/gemma-2-27b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 1.78k • 14

lakkeo/stable-cypher-instruct-3b

Text Generation • Updated Oct 3, 2024 • 1.07k • 26

rootxhacker/CodeAstra-7B

Text Generation • Updated Jul 3, 2024 • 922 • 11

cattoroboto/gemma-2-9b-CharacterCodex-qlora

Updated Jul 2, 2024 • 1

unsloth/Phi-3-mini-4k-instruct-v0-bnb-4bit

Text Generation • Updated Aug 20, 2024 • 174 • 3

unsloth/gemma-2-9b-it-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 10.9k • 29

unsloth/gemma-2-27b-it-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 1.01k • 12

mac999/Llama3-8B-BIM

Text Generation • Updated Jul 11, 2024 • 7 • 1

the1ullneversee/Restful-Llama-3-7b

Text Generation • Updated Jul 11, 2024 • 39 • 1

PrunaAI/apple-OpenELM-270M-bnb-4bit-smashed

Text Generation • Updated Jul 13, 2024 • 18 • 1

robinhad/UAlpaca-2.0-Mistral-7B

Text Generation • Updated Jul 14, 2024 • 32 • 1

unsloth/Mistral-Nemo-Base-2407-bnb-4bit

Text Generation • Updated Feb 2 • 2.26k • 17

unsloth/Mistral-Nemo-Instruct-2407-bnb-4bit

Text Generation • Updated Feb 2 • 147k • 27

Svngoku/kongostral

Text Generation • Updated Jul 23, 2024 • 8 • 3

unsloth/Meta-Llama-3.1-8B-bnb-4bit

Text Generation • Updated Feb 15 • 123k • 102

unsloth/Meta-Llama-3.1-70B-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 5.1k • 31

unsloth/Meta-Llama-3.1-70B-Instruct-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 7.85k • 31

unsloth/Meta-Llama-3.1-405B-bnb-4bit

Text Generation • Updated Sep 11, 2024 • 189 • 16

PrunaAI/Aratako-Oumuamua-7b-RP-bnb-4bit-smashed

Text Generation • Updated Jul 24, 2024 • 5 • 1

ToastyPigeon/SpringDragon-NeMo-Instruct-QLoRA-ep1

Updated Sep 16, 2024 • 2 • 2