Edit Models filters

Apps

Docker Model Runner

Inference Providers

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

16

Full-text search

Active filters: vLLM

model-scope/glm-4-9b-chat-GPTQ-Int4

Text Generation • 2B • Updated Jul 17, 2024 • 58 • 6

model-scope/glm-4-9b-chat-GPTQ-Int8

Text Generation • 3B • Updated Jul 23, 2024 • 35 • 2

tclf90/qwen2.5-72b-instruct-gptq-int4

Text Generation • 12B • Updated May 12 • 53

tclf90/qwen2.5-72b-instruct-gptq-int3

Text Generation • 10B • Updated May 12 • 18

prithivMLmods/Nu2-Lupi-Qwen-14B

Text Generation • 15B • Updated Mar 27 • 14 • 2

mradermacher/Nu2-Lupi-Qwen-14B-GGUF

15B • Updated Mar 29 • 211 • 1

mradermacher/Nu2-Lupi-Qwen-14B-i1-GGUF

15B • Updated Mar 29 • 1.56k • 1

QuantTrio/Qwen3-235B-A22B-GPTQ-Int8

Text Generation • Updated Jun 1 • 56

BeastyZ/Qwen2.5-3B-ConvSearch-R1-TopiOCQA

3B • Updated May 22 • 21

QuantTrio/DeepSeek-R1-0528-Qwen3-8B-GPTQ-Int4-Int8Mix

Text Generation • 2B • Updated May 30 • 1.79k • 1

QuantTrio/DeepSeek-R1-0528-GPTQ-Int4-Int8Mix-Lite

Text Generation • Updated 29 days ago • 336 • 1

QuantTrio/DeepSeek-R1-0528-GPTQ-Int4-Int8Mix-Compact

Text Generation • Updated 14 days ago • 1.94k • 1

QuantTrio/DeepSeek-R1-0528-GPTQ-Int4-Int8Mix-Medium

Text Generation • Updated 13 days ago • 3.22k • 1

brandonbeiler/InternVL3-38B-FP8-Dynamic

Image-Text-to-Text • 38B • Updated 10 days ago • 351

brandonbeiler/InternVL3-78B-FP8-Dynamic

Image-Text-to-Text • 78B • Updated 10 days ago • 1.9k

brandonbeiler/InternVL3-8B-FP8-Dynamic

Image-Text-to-Text • 8B • Updated 10 days ago • 17