Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

AutoTrain Compatible

Inference Endpoints

text-generation-inference

Misc with no match

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

15

Full-text search

Active filters: smooth_quant

internlm/internlm3-8b-instruct-smoothquant-int8

Text Generation • Updated Jan 15 • 28 • 4

internlm/internlm3-8b-instruct-smoothquant-fp8

Text Generation • Updated Jan 17 • 31 • 1

fabiolecca/almawave-velvet-14b-int8

Updated Feb 1 • 3 • 2

adriabama06/DeepCoder-1.5B-Preview-FP8-W8A8

Text Generation • Updated 7 days ago • 7 • 1

noneUsername/Orca-2-13b-w8-lmdeploy

Updated Nov 11, 2024

G-reen/Qwen2.5-Coder-32b-Instruct-Fp8

G-reen/Mistral-Small-2501-Instruct-Fp8

radna/r1-14b-fp8

Updated Feb 28 • 1

radna/r1-7b-fp8

Updated Feb 28 • 1

radna/r1-14b-int8

Updated Mar 1 • 1

radna/r1-14b-float8_e4m3fn

Updated Mar 1 • 2

radna/r1-14b-float8_e5m2

Updated Mar 1 • 1

radna/r1-14b-int8-mid

Updated Mar 1 • 2

radna/r1-14b-float8_e4m3fn-mid

Updated Mar 1 • 2

radna/r1-14b-float8_e5m2-mid

Updated Mar 1 • 2