Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

text-generation-inference

Inference Endpoints

8-bit precision

Misc with no match

4-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

144

Full-text search

Active filters: MosaicML

Abzu/mpt-7b-chat-q8

Text Generation • Updated Jul 7, 2023 • 35 • 1

Abzu/mpt-7b-storywriter-q8

Text Generation • Updated Jul 7, 2023 • 26 • 2

Abzu/mpt-30b-q8

Text Generation • Updated Jul 7, 2023 • 18 • 3

Abzu/mpt-30b-chat-q8

Text Generation • Updated Jul 7, 2023 • 16 • 1

abhinavkulkarni/mosaicml-mpt-30b-instruct-w4-g128-awq

Text Generation • Updated Sep 12, 2023 • 27 • 2

abhinavkulkarni/mosaicml-mpt-30b-chat-w4-g128-awq

Text Generation • Updated Jun 3, 2024 • 17

DanielTTY/mpt-30b-qlora

Text Generation • Updated Jul 12, 2023 • 18

FarziBuilder/fastInferencetry4

Text Generation • Updated Jul 12, 2023 • 22

sl-alex/mosaicml-mpt-7b-chat-qlora

Text Generation • Updated May 30, 2023 • 25

blackmount8/mpt-7b-instruct-ct2-int8_float16

Updated Jul 15, 2023 • 12

eluzhnica/mpt-7b-8k-instruct-peft-compatible

Text Generation • Updated Jul 18, 2023 • 28 • 1

eluzhnica/mpt-7b-8k-peft-compatible

Text Generation • Updated Jul 18, 2023 • 34 • 3

jamesdborin/ct2-int8-mtb-7b

Text Generation • Updated Jul 18, 2023 • 32

jamesdborin/ct2-int8-mtb-7b-storywriter

Text Generation • Updated Jul 18, 2023 • 14

jamesdborin/ct2-int8-mtb-7b-chat

Text Generation • Updated Jul 18, 2023 • 21

jamesdborin/ct2-int8-mtb-7b-8k-instruct

Text Generation • Updated Jul 18, 2023 • 15

jamesdborin/ct2-int8-mpt-7b-8k-chat

Text Generation • Updated Jul 18, 2023 • 19

oleksandrfluxon/mpt-7b-chat-4bit

Text Generation • Updated Jul 21, 2023 • 13

Trelis/mpt-7b-8k-chat-sharded-bf16

Text Generation • Updated Jul 25, 2023 • 17 • 1

oleksandrfluxon/mpt-30b-chat-test

Text Generation • Updated Jul 21, 2023 • 27

hyungtae/mpt-30b

Text Generation • Updated Jul 21, 2023 • 17

oleksandrfluxon/mpt-7b-instruct

Text Generation • Updated Jul 21, 2023 • 18

oleksandrfluxon/mpt-7b-instruct-evaluate

Text Generation • Updated Jul 25, 2023 • 45

oleksandrfluxon/mpt-7b-instruct-2

Text Generation • Updated Jul 23, 2023 • 22

jamesdborin/ct2-int8-mpt-7b-8k

Text Generation • Updated Jul 26, 2023 • 20

casperhansen/mpt-7b-8k-chat-gptq

Text Generation • Updated Jul 27, 2023 • 55 • 2

EchoStreet/mpt-7b

Text Generation • Updated Jul 31, 2023 • 12 • 2

openerotica/mpt-7b-8k-GPTQ

Text Generation • Updated Aug 10, 2023 • 17

Trelis/mpt-7b-instruct-hosted-inference-8bit

Text Generation • Updated Aug 14, 2023 • 12

czurita/mpt-7b-8k-instruct-sharded-bf16-2GB

Text Generation • Updated Aug 20, 2023 • 26