Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

arxiv: 2311.16502

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

199

Full-text search

Active filters: 2311.16502

LoneStriker/Yi-6B-200K-3.0bpw-h6-exl2

Text Generation • Updated Mar 16, 2024 • 3

LoneStriker/Yi-6B-200K-4.0bpw-h6-exl2

Text Generation • Updated Mar 16, 2024 • 3

LoneStriker/Yi-6B-200K-5.0bpw-h6-exl2

Text Generation • Updated Mar 16, 2024 • 3

LoneStriker/Yi-6B-200K-6.0bpw-h6-exl2

Text Generation • Updated Mar 16, 2024 • 13 • 1

LoneStriker/Yi-6B-200K-8.0bpw-h8-exl2

Text Generation • Updated Mar 16, 2024 • 13 • 1

01-ai/Yi-34B-Chat-8bits

Text Generation • Updated Nov 11, 2024 • 79 • 28

01-ai/Yi-6B-Chat-8bits

Text Generation • Updated Nov 11, 2024 • 36 • 9

01-ai/Yi-6B-Chat-4bits

Text Generation • Updated Nov 11, 2024 • 84 • 22

nold/Yi-34B-200K-GGUF

Text Generation • Updated Mar 9, 2024 • 28 • 1

cgus/Yi-9B-exl2

Text Generation • Updated Jun 24, 2024 • 5

TechxGenus/Yi-9B-AWQ

Text Generation • Updated Jun 27, 2024 • 6

TechxGenus/Yi-9B-GPTQ

Text Generation • Updated Jun 25, 2024 • 14

jmoney54378256438905/Yi-34B-200K-MAR2024-exl2-5bpw

Text Generation • Updated Mar 13, 2024 • 3

jmoney54378256438905/Yi-34B-200K-MAR2024-exl2-4bpw

Text Generation • Updated Mar 13, 2024 • 8 • 1

jmoney54378256438905/Yi-34B-200K-MAR2024-exl2-3.5bpw

Text Generation • Updated Mar 13, 2024 • 18

01-ai/Yi-9B-200K

Text Generation • Updated Nov 11, 2024 • 5.54k • 75

LoneStriker/Yi-9B-200K-GGUF

Text Generation • Updated Mar 16, 2024 • 42 • 8

LoneStriker/Yi-9B-200K-3.0bpw-h6-exl2

Text Generation • Updated Mar 16, 2024 • 6 • 1

LoneStriker/Yi-9B-200K-4.0bpw-h6-exl2

Text Generation • Updated Mar 16, 2024 • 3

LoneStriker/Yi-9B-200K-5.0bpw-h6-exl2

Text Generation • Updated Mar 16, 2024 • 13

LoneStriker/Yi-9B-200K-6.0bpw-h6-exl2

Text Generation • Updated Mar 16, 2024 • 5 • 1

LoneStriker/Yi-9B-200K-8.0bpw-h8-exl2

Text Generation • Updated Mar 16, 2024 • 11

LoneStriker/Yi-6B-200K-GGUF

Text Generation • Updated Mar 16, 2024 • 14

TechxGenus/Yi-9B-200K-GPTQ

Text Generation • Updated Jun 27, 2024 • 4

MaziyarPanahi/Yi-9B-200K-GGUF

Text Generation • Updated Mar 18, 2024 • 167 • 6

TechxGenus/Yi-9B-200K-AWQ

Text Generation • Updated Jun 27, 2024 • 3

MaziyarPanahi/Yi-6B-200K-GGUF

Text Generation • Updated Mar 18, 2024 • 66

Joseph717171/BigYi-15.75B-200k

Text Generation • Updated Apr 10, 2024 • 14

RichardErkhov/01-ai_-_Yi-6B-gguf

Updated Apr 13, 2024 • 159

RichardErkhov/01-ai_-_Yi-6B-200K-gguf

Updated Apr 13, 2024 • 35