Edit Models filters

Model Tree

Qwen/Qwen2.5-3B-Instruct

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

129

Full-text search

Active filters: Qwen/Qwen2.5-3B-Instruct

JackeyLai/Qwen2.5-3B-Instruct-Q4_0-GGUF

Text Generation • Updated Dec 12, 2024 • 2

TheBlueObserver/Qwen2.5-3B-Instruct-MLX-0cb1b

Text Generation • Updated Dec 16, 2024 • 4

TheBlueObserver/Qwen2.5-3B-Instruct-MLX-d5688

Text Generation • Updated Dec 16, 2024 • 2

TheBlueObserver/Qwen2.5-3B-Instruct-MLX-c6059

Text Generation • Updated Dec 16, 2024 • 4

TheBlueObserver/Qwen2.5-3B-Instruct-MLX-9a5c2

Text Generation • Updated Dec 16, 2024 • 2

TheBlueObserver/Qwen2.5-3B-Instruct-MLX-104ce

Text Generation • Updated Dec 16, 2024 • 2

TheBlueObserver/Qwen2.5-3B-Instruct-MLX-4c7d1

Text Generation • Updated Dec 16, 2024 • 2

TheBlueObserver/Qwen2.5-3B-Instruct-MLX-884ea

Text Generation • Updated Dec 16, 2024 • 2

TheBlueObserver/Qwen2.5-3B-Instruct-MLX-b4ecb

Text Generation • Updated Dec 16, 2024 • 2

TheBlueObserver/Qwen2.5-3B-Instruct-MLX-196c8

Text Generation • Updated Dec 16, 2024 • 4

TheBlueObserver/Qwen2.5-3B-Instruct-MLX-9f4aa

Text Generation • Updated Dec 16, 2024 • 2

TheBlueObserver/Qwen2.5-3B-Instruct-MLX-cea54

Text Generation • Updated Dec 16, 2024 • 2

TheBlueObserver/Qwen2.5-3B-Instruct-MLX-7dd7f

Text Generation • Updated Dec 16, 2024 • 2

TheBlueObserver/Qwen2.5-3B-Instruct-MLX-8777b

Text Generation • Updated Dec 16, 2024 • 4

TheBlueObserver/Qwen2.5-3B-Instruct-MLX-83acc

Text Generation • Updated Dec 16, 2024 • 6

TheBlueObserver/Qwen2.5-3B-Instruct-MLX-2ec71

Text Generation • Updated Dec 16, 2024 • 4

TheBlueObserver/Qwen2.5-3B-Instruct-MLX-c79ba

Text Generation • Updated Dec 16, 2024 • 4

TheBlueObserver/Qwen2.5-3B-Instruct-MLX-393a7

Text Generation • Updated Dec 16, 2024 • 6

TheBlueObserver/Qwen2.5-3B-Instruct-MLX-a720d

Text Generation • Updated Dec 16, 2024 • 6

TheBlueObserver/Qwen2.5-3B-Instruct-MLX-6155e

Text Generation • Updated Dec 16, 2024 • 4

TheBlueObserver/Qwen2.5-3B-Instruct-MLX-e36bb

Text Generation • Updated Dec 16, 2024 • 6

Zenabius/Qwen2.5-3B-Instruct-exl2

Updated Dec 19, 2024 • 2

Vijay109/Qwen2.5-3B-Instruct-Q8_0-GGUF

Text Generation • Updated Dec 20, 2024 • 3

QuantFactory/SmallThinker-3B-Preview-GGUF

Updated Dec 31, 2024 • 305 • 3

smoothgift/Qwen2.5-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Jan 3 • 3

msyukorai/Qwen2.5-3B-Instruct-Q4_0-GGUF

Text Generation • Updated Jan 5 • 2

itlwas/Qwen2.5-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Jan 5 • 4

JustineF/Qwen2.5-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Jan 8 • 1

roleplaiapp/SmallThinker-3B-Preview-Q2_K-GGUF

Text Generation • Updated Jan 16 • 5

roleplaiapp/SmallThinker-3B-Preview-Q3_K_S-GGUF

Text Generation • Updated Jan 16 • 5