Edit Models filters

Model Tree

Qwen/Qwen2.5-32B-Instruct

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

126

Full-text search

Active filters: Qwen/Qwen2.5-32B-Instruct

TheRains/Qwen2.5-32B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 23, 2024 • 11

mradermacher/Qwen2.5-32B-Instruct-GGUF

Updated Dec 29, 2024 • 137

mradermacher/Qwen2.5-32B-Instruct-i1-GGUF

Updated Dec 29, 2024 • 398 • 1

hewengao/Qwen2.5-32B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 27, 2024 • 1

jacobcarajo/Qwen2.5-32B-Instruct-Q5_K_M-GGUF

Text Generation • Updated Oct 2, 2024 • 10

VPTQ-community/Qwen2.5-32B-Instruct-v16-k65536-65536-woft

Updated Nov 18, 2024 • 2 • 1

VPTQ-community/Qwen2.5-32B-Instruct-v8-k65536-0-woft

Updated Nov 18, 2024 • 17

VPTQ-community/Qwen2.5-32B-Instruct-v8-k65536-65536-woft

Updated Nov 18, 2024 • 8

VPTQ-community/Qwen2.5-32B-Instruct-v8-k256-256-woft

Updated Nov 18, 2024 • 3

VPTQ-community/Qwen2.5-32B-Instruct-v8-k65536-256-woft

Updated Nov 18, 2024 • 6 • 2

WPAI-INC/WPAIGPT-fse-patterns-1

Text Generation • Updated Oct 9, 2024 • 71

zetasepic/Qwen2.5-32B-Instruct-abliterated-v2-4.65bpw-exl2

Text Generation • Updated Oct 12, 2024 • 4

zetasepic/Qwen2.5-32B-Instruct-abliterated-v2-6.5bpw-exl2

Text Generation • Updated Oct 12, 2024 • 14 • 1

zetasepic/Qwen2.5-32B-Instruct-abliterated-v2-8.0bpw-exl2

Text Generation • Updated Oct 12, 2024 • 4

cksghl1004/Qwen2.5-32B-Instruct-AWQ

Text Generation • Updated Oct 14, 2024 • 3

noxinc/Qwen2.5-32B-Instruct-Q5_K_M-GGUF

Text Generation • Updated Oct 15, 2024 • 3

Jellon/Qwen2.5-32B-Instruct-abliterated-exl2-4bpw

Text Generation • Updated Oct 19, 2024 • 12

mav23/Rombos-LLM-V2.5-Qwen-32b-GGUF

Updated Oct 20, 2024 • 225

mav23/Qwen2.5-32B-AGI-GGUF

Updated Oct 23, 2024 • 493

jth01/Rombos-LLM-V2.5-Qwen-32b-4.0bpw-exl2

Text Generation • Updated Oct 24, 2024 • 4

KnutJaegersberg/CompassJudger-1-32B-Instruct-exl2-8.0bpw

Updated Oct 26, 2024 • 5

async0x42/Rombos-LLM-V2.5-Qwen-32b-exl2_5.0bpw

Text Generation • Updated Oct 27, 2024 • 3

async0x42/Rombos-LLM-V2.5-Qwen-32b-exl2_4.0bpw

Text Generation • Updated Oct 27, 2024 • 1

async0x42/Rombos-LLM-V2.5-Qwen-32b-exl2_4.5bpw

Text Generation • Updated Oct 27, 2024 • 3

FelixSAG/Qwen2.5-32B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Nov 4, 2024 • 1

lmstudio-community/Qwen2.5-32B-Instruct-MLX-4bit

Text Generation • Updated Nov 13, 2024 • 163 • 1

lmstudio-community/Qwen2.5-32B-Instruct-MLX-8bit

Text Generation • Updated Nov 13, 2024 • 87

tensorblock/Qwen2.5-32B-Instruct-GGUF

Text Generation • Updated 6 days ago • 286

mav23/CompassJudger-1-32B-Instruct-GGUF

Updated Nov 15, 2024 • 88

nm-testing/Qwen2.5-32B-Instruct-FP8-dynamic

Updated Nov 15, 2024 • 193 • 1