Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

8-bit precision

Inference Endpoints

text-generation-inference

4-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

26,125

Full-text search

Active filters: 8-bit

gretelai/falcon-7b

Text Generation • Updated Jul 10, 2023 • 20

sgowdaks/falcon-40b-instruct-8bit

Updated Jul 11, 2023 • 7

rosyvs/whisat

Automatic Speech Recognition • Updated Apr 29 • 12 • 2

FabbriSimo01/GPT_Large_Quantized

Text Generation • Updated Jul 15, 2023 • 170

FabbriSimo01/Bloom_1b_Quantized

Text Generation • Updated Jul 15, 2023 • 157

FabbriSimo01/Facebook_opt_1.3b_Quantized

Text Generation • Updated Jul 15, 2023 • 170

FabbriSimo01/Cerebras_1.3b_Quantized

Text Generation • Updated Jul 15, 2023 • 162

vivekraina/Falcon-8bit-test

Text Generation • Updated Jul 19, 2023 • 16

trillionmonster/Baichuan-13B-Chat-8bit

Text Generation • Updated Jul 25, 2023 • 26 • 9

vivekraina/Llama-2-7b-hf-8bit

Text Generation • Updated Jul 20, 2023 • 13 • 3

guardrail/llama-2-7b-guanaco-8bit-sharded

Text Generation • Updated Jul 20, 2023 • 22 • 4

richardr1126/spider-skeleton-wizard-coder-8bit

Text Generation • Updated Jul 26, 2023 • 25 • 1

rbiswasfc/falcon-7b-8bit

Text Generation • Updated Jul 21, 2023 • 32

pligor/gr7.5b-dolly

Text Generation • Updated Jul 24, 2023 • 17 • 1

Mediocreatmybest/instructblip-vicuna-7b_8bit

Image-to-Text • Updated Nov 19, 2023 • 20 • 3

osiria/primo

Text Generation • Updated Aug 12, 2023 • 21 • 2

vivym/chatglm2-6b-int4

Text2Text Generation • Updated Jul 27, 2023 • 11

0prodigy/axolotl

Text Generation • Updated Oct 17, 2023 • 17

Matsakitkat/Mobility_Future_expectation

Text Generation • Updated Aug 1, 2023 • 18

anhtunguyen98/flan-t5-xxl-8bit

Text2Text Generation • Updated Jul 28, 2023 • 9

vivekraina/Llama-2-13b-chat-hf-8bit

Text Generation • Updated Jul 28, 2023 • 11

Mediocreatmybest/instructblip-vicuna-13b_8bit

Image-Text-to-Text • Updated Nov 19, 2023 • 14

TransformerTales/llama-2-7b-8bit-nested

Text Generation • Updated Aug 5, 2023 • 22 • 2

legendhasit/xgen-7b-8k-open-instruct-8bit

Text Generation • Updated Jul 31, 2023 • 20

Harshvir/LaMini-Neo-1.3B-Mental-Health_lora

Text Generation • Updated Jul 31, 2023 • 161 • 2

manojkumarvohra/llama2-7B-8bit-guanaco-pico-finetuned

Text Generation • Updated Aug 1, 2023 • 16

valhalla/muse-laiona5-oai-clip-384res-8bit

Updated Aug 1, 2023 • 10

snigdhachandan/gtr_large_8bit

Feature Extraction • Updated Aug 3, 2023 • 11

Mursel/redpj3B-lora-int8-alpaca

Updated Aug 3, 2023 • 3

Harshvir/open_llama_3b-Physics

Text Generation • Updated Aug 10, 2023 • 15