Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

8-bit precision

4-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

text-embeddings-inference

Mixture of Experts

Carbon Emissions

Models

37,254

Full-text search

Active filters: bitsandbytes

unsloth/Hermes-2-Pro-Mistral-7B-bnb-4bit

Text Generation • Updated Apr 7, 2024 • 38 • 1

unsloth/OpenHermes-2.5-Mistral-7B-bnb-4bit

Text Generation • Updated Apr 7, 2024 • 61 • 3

unsloth/codegemma-2b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 764 • 1

unsloth/codegemma-7b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 550 • 3

unsloth/codegemma-7b-it-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 576 • 1

somosnlp/LLM_SQL_BaseDatosEspanol_Mistral

Text Generation • Updated Apr 25, 2024 • 59 • 11

PrunaAI/Universal-NER-UniNER-7B-all-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 13 • 1

GGmorello/FLAMES

Text Generation • Updated Jun 11, 2024 • 9 • 1

unsloth/llama-3-8b-bnb-4bit

Text Generation • Updated Jan 7 • 83.8k • 197

unsloth/llama-3-8b-Instruct-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 58.6k • 132

unsloth/llama-3-70b-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 591 • 46

haes95/lm3-8-bnb-4bit-v1.0

Text Generation • Updated Apr 21, 2024 • 6 • 1

DevsDoCode/LLama-3-8b-Uncensored-4bit

Text Generation • Updated Apr 25, 2024 • 33 • 21

unsloth/llama-3-70b-Instruct-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 1.4k • 42

RichardErkhov/meta-llama_-_Meta-Llama-3-8B-Instruct-4bits

Text Generation • Updated May 2, 2024 • 5 • 1

islam23/llama3-8b-RAG_News_Finance

Text Generation • Updated May 14, 2024 • 3 • 2

zementalist/llama-3-8B-chat-psychotherapist

Text Generation • Updated Apr 29, 2024 • 190 • 26

bongodongo/phi-3-mini-4k-instruct-q4

Text Generation • Updated Apr 28, 2024 • 25 • 1

unsloth/Phi-3-mini-4k-instruct-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 8.24k • 29

totally-not-an-llm/babelfish-1.1b-v0.1-qlora

Updated Apr 30, 2024 • 1

unsloth/Yi-1.5-6B-bnb-4bit

Text Generation • Updated May 13, 2024 • 24 • 3

Lokesh477/healthcare_llm

Text Generation • Updated May 14, 2024 • 32 • 1

bineric/NorskGPT-Llama-3-70b-adapter

Text Generation • Updated May 21, 2024 • 15 • 6

openbmb/MiniCPM-Llama3-V-2_5-int4

Visual Question Answering • Updated Feb 27 • 24k • 71

unsloth/mistral-7b-v0.3-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 22.7k • 16

unsloth/mistral-7b-instruct-v0.3-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 214k • 25

unsloth/Phi-3-medium-4k-instruct-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 2.06k • 5

THUDM/cogvlm2-llama3-chat-19B-int4

Text Generation • Updated May 24, 2024 • 479 • 28

lllyasviel/omost-dolphin-2.9-llama3-8b-4bits

Text Generation • Updated May 29, 2024 • 76 • 6

lllyasviel/omost-phi-3-mini-128k-8bits

Text Generation • Updated May 29, 2024 • 35 • 7