Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

8-bit precision

text-embeddings-inference

4-bit precision

Misc with no match

Carbon Emissions

Mixture of Experts

Models

233

Full-text search

Active filters: int8

Weblet/Llama-2-7b-chat-hf-ct2-int8

Text Generation • Updated Apr 30 • 1

Anthonyg5005/L3-8B-Stheno-v3.1-int8-ct2

Text Generation • Updated Jun 17 • 11

Anthonyg5005/turbcat-instruct-8b-int8-ct2

Text Generation • Updated Jun 20 • 11

angeloc1/llama3dot1SimilarProcesses8

Text Generation • Updated Jul 27 • 6

angeloc1/llama3dot1DifferentProcesses8

Text Generation • Updated Jul 27 • 8

FriendliAI/Meta-Llama-3-8B-int8

Text Generation • Updated Aug 1 • 25 • 1

neuralmagic/Meta-Llama-3.1-8B-quantized.w8a16

Text Generation • Updated Oct 9 • 393 • 1

neuralmagic/Meta-Llama-3.1-8B-quantized.w8a8

Text Generation • Updated 21 days ago • 576 • 1

neuralmagic/gemma-2-9b-it-quantized.w8a16

Text Generation • Updated Oct 9 • 3.01k • 1

neuralmagic/gemma-2-2b-it-quantized.w8a16

Text Generation • Updated Oct 9 • 65 • 1

neuralmagic/gemma-2-2b-quantized.w8a16

Text Generation • Updated Oct 9 • 72

neuralmagic/SmolLM-1.7B-Instruct-quantized.w8a16

Text Generation • Updated Oct 9 • 44

neuralmagic/gemma-2-2b-it-quantized.w8a8

Text Generation • Updated Oct 9 • 464

angeloc1/llama3dot1FoodDel8v02

Text Generation • Updated Aug 18 • 8

neuralmagic/Meta-Llama-3.1-405B-Instruct-quantized.w8a16

Text Generation • Updated Oct 9 • 583 • 2

neuralmagic/SmolLM-360M-Instruct-quantized.w8a8

Text Generation • Updated Oct 9 • 17

neuralmagic/SmolLM-135M-Instruct-quantized.w8a8

Text Generation • Updated Oct 9 • 644

neuralmagic/SmolLM-1.7B-Instruct-quantized.w8a8

Text Generation • Updated Oct 9 • 26

zzzmahesh/Meta-Llama-3-8B-Instruct-quantized.w8a8

Text Generation • Updated Sep 7 • 8

FriendliAI/Meta-Llama-3.1-8B-Instruct-int8

Text Generation • Updated Sep 9 • 18 • 1

FriendliAI/Meta-Llama-3.1-70B-Instruct-int8

Text Generation • Updated Sep 9 • 40

avans06/Meta-Llama-3.1-8B-Instruct-ct2-int8_float16

Text Generation • Updated Oct 10 • 22

avans06/Meta-Llama-3.2-8B-Instruct-ct2-int8_float16

Text Generation • Updated about 1 month ago • 50