Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Misc with no match

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

17

Full-text search

Active filters: fbgemm_fp8

nm-testing/llama-3-8b-instruct-fbgemm-test-model

Text Generation • Updated Jul 18, 2024 • 14

nm-testing/Meta-Llama-3-8B-Instruct-FBGEMM-nonuniform

Text Generation • Updated Jul 20, 2024 • 68

meta-llama/Llama-3.1-405B-Instruct-FP8

Text Generation • Updated Sep 25, 2024 • 2.41k • 188

meta-llama/Llama-3.1-405B-FP8

Text Generation • Updated Dec 6, 2024 • 1.6k • • 117

nm-testing/Meta-Llama-3-70B-Instruct-FBGEMM-nonuniform

Text Generation • Updated Jul 20, 2024 • 97 • 1

PrimeIntellect/Meta-Llama-3.1-405B-Instruct-FP8

Text Generation • Updated Aug 16, 2024 • 25

NousResearch/Meta-Llama-3.1-405B-FP8

Text Generation • Updated Jul 25, 2024 • 15 • 3

Bllossom/llama-3.1-Korean-Bllossom-405B

Text Generation • Updated Dec 13, 2024 • 39 • 55

PygmalionAI/Eleusis-12B-FBGEMM-FP8

Text Generation • Updated Jan 29 • 5

mikeriess/Llama-3.3-70B-Instruct-FP8

Text Generation • Updated Mar 11 • 11

mikeriess/Gemma-2-27B-IT-FP8

Text Generation • Updated Mar 11 • 13

mikeriess/Llama-3.1-Nemotron-70B-Reward-HF-FP8

Text Generation • Updated Mar 12 • 12

InfiniAILab/QwQ-32B-FP8

Updated Mar 16 • 6

hugging-quants/Llama-4-Scout-17B-16E-Instruct-fbgemm-unfused

Image-Text-to-Text • Updated Apr 9 • 37 • 1

hugging-quants/Llama-4-Scout-17B-16E-Instruct-fbgemm

Image-Text-to-Text • Updated Apr 9 • 133 • 2

chutesai/Llama-3.1-405B-FP8

Text Generation • Updated Apr 20 • 1.62k

haoqiwang/MNLP_M2_quantized_model

Text Generation • Updated 12 days ago • 69