Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

Misc with no match

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

15

Full-text search

Active filters: fbgemm_fp8

meta-llama/Llama-3.1-405B-FP8

Text Generation • Updated Dec 6, 2024 • 1.06k • 115

Bllossom/llama-3.1-Korean-Bllossom-405B

Text Generation • Updated Dec 13, 2024 • 58 • 55

hugging-quants/Llama-4-Scout-17B-16E-Instruct-fbgemm-unfused

Image-Text-to-Text • Updated 6 days ago • 9 • 1

nm-testing/llama-3-8b-instruct-fbgemm-test-model

Text Generation • Updated Jul 18, 2024 • 2

nm-testing/Meta-Llama-3-8B-Instruct-FBGEMM-nonuniform

Text Generation • Updated Jul 20, 2024 • 2

meta-llama/Llama-3.1-405B-Instruct-FP8

Text Generation • Updated Sep 25, 2024 • 8.16k • 188

nm-testing/Meta-Llama-3-70B-Instruct-FBGEMM-nonuniform

Text Generation • Updated Jul 20, 2024 • 21 • 1

PrimeIntellect/Meta-Llama-3.1-405B-Instruct-FP8

Text Generation • Updated Aug 16, 2024 • 6

NousResearch/Meta-Llama-3.1-405B-FP8

Text Generation • Updated Jul 25, 2024 • 10 • 3

PygmalionAI/Eleusis-12B-FBGEMM-FP8

Text Generation • Updated Jan 29 • 11

mikeriess/Llama-3.3-70B-Instruct-FP8

Text Generation • Updated Mar 11 • 7

mikeriess/Gemma-2-27B-IT-FP8

Text Generation • Updated Mar 11 • 23

mikeriess/Llama-3.1-Nemotron-70B-Reward-HF-FP8

Text Generation • Updated Mar 12 • 1

InfiniAILab/QwQ-32B-FP8

Updated 30 days ago • 146

hugging-quants/Llama-4-Scout-17B-16E-Instruct-fbgemm

Image-Text-to-Text • Updated 6 days ago • 196