4bit Instruct Models - a unsloth Collection

unsloth 's Collections

DeepSeek R1 (All Versions)

Unsloth Dynamic 2.0 Quants

Qwen3

Llama 4

Phi-4 (All Versions)

Gemma 3

Unsloth 4-bit Dynamic Quants

Deepseek V3 (All Versions)

Text-to-Speech (TTS) models

Mistral Small 3 (All Versions)

Llama 3.3 (All Versions)

Qwen2.5-VL (All Versions)

Qwen QwQ-32B Collection

Vision/multimodal Models

Llama 3.2 Vision

Llama 3.1 Collection

Load 4bit models 4x faster

4bit Instruct Models

4bit Instruct Models

updated May 30

unsloth/Llama-3.2-3B-Instruct-bnb-4bit

Text Generation • 2B • Updated 28 days ago • 44.9k • 20
unsloth/Llama-3.2-1B-Instruct-bnb-4bit

Text Generation • 0.8B • Updated Jan 23 • 21k • 16
unsloth/Llama-3.2-11B-Vision-Instruct-bnb-4bit

Image-Text-to-Text • 6B • Updated Dec 10, 2024 • 14.6k • 77
unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit

Text Generation • 5B • Updated Feb 15 • 389k • 76
unsloth/llama-3-8b-Instruct-bnb-4bit

Text Generation • 5B • Updated Nov 22, 2024 • 77.5k • 135
unsloth/Meta-Llama-3.1-70B-Instruct-bnb-4bit

Text Generation • 37B • Updated Nov 22, 2024 • 4.52k • 31
unsloth/Phi-3-mini-4k-instruct-bnb-4bit

Text Generation • 2B • Updated Sep 3, 2024 • 8.35k • 29
unsloth/Mistral-Nemo-Instruct-2407-bnb-4bit

Text Generation • 7B • Updated Feb 2 • 358k • 27
unsloth/gemma-2-9b-it-bnb-4bit

Text Generation • 5B • Updated Nov 22, 2024 • 8.98k • 30
unsloth/mistral-7b-instruct-v0.2-bnb-4bit

Text Generation • 4B • Updated Nov 22, 2024 • 16.4k • 32
unsloth/mistral-7b-instruct-v0.3-bnb-4bit

Text Generation • 4B • Updated Nov 22, 2024 • 58.6k • 28
unsloth/llama-3-70b-Instruct-bnb-4bit

Text Generation • 37B • Updated Sep 3, 2024 • 2.12k • 42
unsloth/Phi-3-medium-4k-instruct-bnb-4bit

Text Generation • 7B • Updated 16 days ago • 1k • 6
unsloth/gemma-7b-it-bnb-4bit

Text Generation • 5B • Updated Sep 3, 2024 • 3.58k • 15
unsloth/gemma-2b-it-bnb-4bit

Text Classification • 2B • Updated Sep 3, 2024 • 3.42k • 20
unsloth/Hermes-3-Llama-3.1-8B-bnb-4bit

Text Generation • 5B • Updated Sep 4, 2024 • 2.39k • 5
unsloth/Hermes-3-Llama-3.1-70B-bnb-4bit

Text Generation • 37B • Updated Sep 4, 2024 • 1.76k • 1
unsloth/Llama-3.1-Storm-8B-bnb-4bit

Text Generation • 5B • Updated Sep 4, 2024 • 1.84k • 7