Edit Models filters

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

4,204

Full-text search

Active filters: chat

neuralmagic/Qwen2.5-3B-FP8-dynamic

Text Generation • Updated Dec 3, 2024 • 7

neuralmagic/Qwen2.5-7B-FP8-dynamic

Text Generation • Updated Dec 3, 2024 • 6

nanowell/QwQ-32B-Preview-Q4_K_M-GGUF

Text Generation • Updated Nov 27, 2024 • 24 • 7

orabazes/QwQ-32B-Preview-GGUF

Text Generation • Updated Nov 27, 2024 • 7 • 2

tensorblock/leniachat-qwen2-1.5B-v0-GGUF

Updated Nov 27, 2024 • 14

mlx-community/QwQ-32B-Preview-4bit

Text Generation • Updated Nov 27, 2024 • 97 • 3

mlx-community/QwQ-32B-Preview-3bit

Text Generation • Updated Nov 28, 2024 • 40 • 5

mlx-community/QwQ-32B-Preview-6bit

Text Generation • Updated Nov 27, 2024 • 97 • 4

mlx-community/QwQ-32B-Preview-8bit

Text Generation • Updated Nov 27, 2024 • 98 • 5

mlx-community/QwQ-32B-Preview-bf16

Text Generation • Updated Nov 27, 2024 • 110 • 5

sbeltz/QwQ-32B-Preview-Q3_K_S-GGUF

Text Generation • Updated Nov 27, 2024 • 15 • 3

Beygo/QwQ-32B-Preview-Q8-mlx

Text Generation • Updated Nov 27, 2024 • 5 • 1

ashercn97/QwQ-32B-Preview-Q2_K-GGUF

Text Generation • Updated Nov 27, 2024 • 1

ivanfioravanti/QwQ-32B-Preview-4bit

Text Generation • Updated Nov 27, 2024 • 22 • 2

async0x42/QwQ-32B-Preview-exl2_4.0bpw

Text Generation • Updated Nov 29, 2024 • 5

mradermacher/SD-Prompter-1.5B-V0.1-GGUF

Updated Nov 28, 2024 • 190 • 1

mradermacher/SD-Prompter-1.5B-V0.1-i1-GGUF

Updated Nov 28, 2024 • 79 • 1

ThomasBaruzier/Qwen2.5-Coder-32B-Instruct-EXL2

Text Generation • Updated Nov 30, 2024 • 103

ThomasBaruzier/Qwen2.5-Coder-32B-Instruct-GGUF

Text Generation • Updated Nov 29, 2024 • 395

bartowski/QwQ-32B-Preview-exl2

Text Generation • Updated Nov 28, 2024 • 43 • 13

mradermacher/QwQ-32B-Preview-i1-GGUF

Updated Dec 12, 2024 • 130 • 1

neuralmagic/Qwen2.5-72B-FP8-dynamic

Text Generation • Updated Dec 3, 2024 • 10

apto-as/Qwen2.5-0.5B-Instruct-Q8_0-GGUF

Text Generation • Updated Nov 28, 2024 • 3

apto-as/Qwen2.5-Coder-14B-Instruct-Q8_0-GGUF

Text Generation • Updated Nov 28, 2024 • 6

second-state/QwQ-32B-Preview-GGUF

Text Generation • Updated Nov 28, 2024 • 62

gaianet/QwQ-32B-Preview-GGUF

Text Generation • Updated Nov 28, 2024 • 50

QuantFactory/SD-Prompter-1.5B-V0.1-GGUF

Updated Nov 29, 2024 • 764 • 3

shashikanth-a/tinyllama-chat-4bit

Text Generation • Updated Nov 28, 2024 • 77

shashikanth-a/llama-2-7b-chat-4bit

Text Generation • Updated Nov 28, 2024 • 82

AIR-hl/Llama-3.2-1B-DPO

Text Generation • Updated Dec 24, 2024 • 143