Edit Models filters

Model Tree

Qwen/Qwen2.5-3B-Instruct

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

101

Full-text search

Active filters: Qwen/Qwen2.5-3B-Instruct

roleplaiapp/SmallThinker-3B-Preview-Q4_K_M-GGUF

Text Generation • Updated 15 days ago • 1

roleplaiapp/SmallThinker-3B-Preview-Q5_0-GGUF

Text Generation • Updated 15 days ago • 21

roleplaiapp/SmallThinker-3B-Preview-Q5_K_S-GGUF

Text Generation • Updated 15 days ago • 23

roleplaiapp/SmallThinker-3B-Preview-Q5_K_M-GGUF

Text Generation • Updated 15 days ago • 21

roleplaiapp/SmallThinker-3B-Preview-Q6_K-GGUF

Text Generation • Updated 15 days ago • 19

roleplaiapp/SmallThinker-3B-Preview-Q8_0-GGUF

Text Generation • Updated 15 days ago • 26

roleplaiapp/SmallThinker-3B-Preview-IQ3_M-GGUF

Text Generation • Updated 15 days ago • 19

roleplaiapp/SmallThinker-3B-Preview-IQ3_XXS-GGUF

Text Generation • Updated 15 days ago • 21

roleplaiapp/SmallThinker-3B-Preview-IQ4_NL-GGUF

Text Generation • Updated 15 days ago • 20

roleplaiapp/SmallThinker-3B-Preview-IQ4_XS-GGUF

Text Generation • Updated 15 days ago • 22

matrixportal/Qwen2.5-3B-Instruct-GGUF

Text Generation • Updated 7 days ago • 59