Edit Models filters

Inference status

Misc

8-bit precision

4-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

text-embeddings-inference

Mixture of Experts

Misc with no match

Carbon Emissions

Models

20,402

Full-text search

Active filters: bitsandbytes

unsloth/phi-4-unsloth-bnb-4bit

Text Generation • Updated 5 days ago • 27.9k • 29

prithivMLmods/Blaze.1-7B-Vision

Image-Text-to-Text • Updated 3 days ago • 100 • 7

prithivMLmods/Blazer.1-2B-Vision

Image-Text-to-Text • Updated 3 days ago • 90 • 7

pzc163/MiniCPMv2_6-prompt-generator

Updated Aug 24, 2024 • 579 • 41

unsloth/Llama-3.3-70B-Instruct-bnb-4bit

Text Generation • Updated 11 days ago • 98.6k • 28

unsloth/Qwen2.5-7B-Instruct-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 122k • 9

unsloth/Qwen2.5-14B-Instruct-bnb-4bit

Text Generation • Updated Sep 23, 2024 • 15.7k • 4

unsloth/Llama-3.2-11B-Vision-Instruct-bnb-4bit

Image-Text-to-Text • Updated Dec 10, 2024 • 16.5k • 66

unsloth/QwQ-32B-Preview-unsloth-bnb-4bit

Text Generation • Updated Dec 6, 2024 • 1.13k • 17

lumolabs-ai/Lumo-8B-Instruct

Updated 2 days ago • 502 • 2

CyberNative/CyberBase-13b

Text Generation • Updated May 16, 2024 • 229 • 26

unsloth/llama-2-7b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 6.33k • 9

Tann-dev/sex-chat-dirty-girlfriend

Text Generation • Updated Feb 17, 2024 • 770 • 26

unsloth/llama-3-8b-bnb-4bit

Text Generation • Updated 11 days ago • 538k • 191

unsloth/mistral-7b-instruct-v0.3-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 151k • 16

sdasd112132/Vision-8B-MiniCPM-2_5-Uncensored-and-Detailed-4bit

Visual Question Answering • Updated Jun 1, 2024 • 591 • 26

unsloth/Qwen2-1.5B-Instruct-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 809 • 1

nikravan/glm-4vq

Document Question Answering • Updated Jun 16, 2024 • 736 • 28

PrunaAI/GreatCaptainNemo-ProLLaMA-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 60 • 1

unsloth/gemma-2-9b-it-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 70k • 21

meta-llama/Llama-Guard-3-8B-INT8

Text Generation • Updated Aug 7, 2024 • 2.03k • 32

unsloth/Meta-Llama-3.1-8B-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 264k • 91

unsloth/Meta-Llama-3.1-70B-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 4.14k • 30

openbmb/MiniCPM-V-2_6-int4

Image-Text-to-Text • Updated 3 days ago • 192k • 70

informatiker/Hermes-3-Llama-3.1-8B-4bit

Updated Aug 15, 2024 • 2 • 2

unsloth/Qwen2.5-72B-Instruct-bnb-4bit

Text Generation • Updated Sep 23, 2024 • 7.46k • 4

unsloth/Qwen2.5-Coder-7B-bnb-4bit

Text Generation • Updated Nov 12, 2024 • 4.8k • 5

SeanScripts/pixtral-12b-nf4

Image-Text-to-Text • Updated Sep 26, 2024 • 574 • 20

unsloth/Llama-3.2-3B-Instruct-bnb-4bit

Text Generation • Updated 2 days ago • 219k • 15

unsloth/Llama-3.2-90B-Vision-Instruct-bnb-4bit

Image-Text-to-Text • Updated Nov 22, 2024 • 1.03k • 17