Edit Models filters

Model Tree

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

96

Full-text search

Active filters: Qwen/Qwen3-4B

Triangle104/Qwen3-4B-Q4_K_M-GGUF

Text Generation • Updated Apr 29 • 5

Triangle104/Qwen3-4B-Q5_K_S-GGUF

Text Generation • Updated Apr 29 • 1

Triangle104/Qwen3-4B-Q5_K_M-GGUF

Text Generation • Updated Apr 29 • 5

Triangle104/Qwen3-4B-Q6_K-GGUF

Text Generation • Updated Apr 29 • 6

Triangle104/Qwen3-4B-Q8_0-GGUF

Text Generation • Updated Apr 29 • 3

itlwas/Qwen3-4B-Q4_K_M-GGUF

Text Generation • Updated Apr 29 • 12

kkioikk/Qwen3-4B-Q8_0-GGUF

Text Generation • Updated Apr 29 • 1

DevQuasar/Qwen.Qwen3-4B-GGUF

Text Generation • Updated May 4 • 54

mradermacher/Qwen3-4B-GGUF

Updated Apr 29 • 22 • 1

Orion-zhen/Qwen3-4B-AWQ

Updated Apr 29 • 1.48k • 1

mradermacher/Qwen3-4B-i1-GGUF

Updated Apr 29 • 135 • 3

zhiqing/Qwen3-4B-INT8

Text Generation • Updated Apr 29 • 1.37k

Alcoft/Qwen3-4B-GGUF

Text Generation • Updated Apr 29 • 50

enacimie/Qwen3-4B-Q4_K_M-GGUF

Text Generation • Updated Apr 29 • 47

abhishekchohan/Qwen3-4B-AWQ

Updated Apr 30 • 1.26k

miku552/Qwen3-4B-Q4_0-GGUF

Text Generation • Updated Apr 30 • 30

DavidAU/Qwen3-4B-Q8_0-64k-128k-256k-context-GGUF

Text Generation • Updated May 2 • 379 • 2

CobraMamba/Qwen3-4B-AWQ

Text Generation • Updated Apr 30 • 1.26k

OpenVINO/Qwen3-4B-int8-ov

Updated Apr 30 • 41

OpenVINO/Qwen3-4B-int4-ov

Updated 17 days ago • 1.91k

tinybiggames/Qwen3-4B-Q4_K_M-GGUF

Text Generation • Updated Apr 30 • 3

tinybiggames/Qwen3-4B-Q8_0-GGUF

Text Generation • Updated Apr 30 • 2

sabafallah/Qwen3-4B-Q4_K_M-GGUF

Text Generation • Updated May 1 • 6

mlc-ai/Qwen3-4B-q4f16_1-MLC

Updated May 1 • 170 • 1

mlc-ai/Qwen3-4B-q4f16_0-MLC

Updated May 1 • 15

mlc-ai/Qwen3-4B-q0f16-MLC

Updated May 1 • 11 • 1

mlc-ai/Qwen3-4B-q4f32_1-MLC

Updated May 1 • 65

kaitchup/Qwen3-4B-autoround-4bit-gptq

Updated May 2 • 2.11k • 1

DavidAU/Qwen3-4B-Mishima-Imatrix-GGUF

Text Generation • Updated May 2 • 37 • 3

RedHatAI/Qwen3-4B-quantized.w4a16

Text Generation • Updated May 13 • 122