Edit Models filters

Apps

Docker Model Runner

Inference Providers

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

13

Full-text search

Active filters: 2.5-bit

ReadyArt/Abomilectrasafemaster-70B_EXL2_2.5bpw_H8

Text Generation • Updated Mar 23 • 8

ReadyArt/Legion-V2.2-LLaMa-70B_EXL2_2.5bpw_H8

Text Generation • Updated Mar 25 • 6

ReadyArt/Llama_3.x_70b_Hexagon_Purple_V2_EXL2_2.5bpw_H8

Text Generation • Updated Mar 26 • 6

ReadyArt/Scrivener-Base-V3-LLaMA-70B_EXL2_2.5bpw_H8

Text Generation • Updated Mar 27 • 7

ReadyArt/Anathema-V2-LLaMA-70B_EXL2_2.5bpw_H8

Text Generation • Updated Mar 27 • 7

Mawdistical/Feline-Clairvoyance-72B_EXL2_2.5bpw_H8

Updated Mar 29 • 3

ReadyArt/Forgotten-Abomination-70B-v5.0_EXL2_2.5bpw_H8

Text Generation • Updated Mar 30 • 6

Mawdistical/Wanton-Wolf-70B_EXL2_2.5bpw_H8

Updated Mar 30 • 4

ReadyArt/Gaslight-24B-v1.0_EXL2_2.5bpw_H8

Text Generation • Updated Apr 2 • 7

ReadyArt/Gaslit-Transgression-24B-v1.0_EXL2_2.5bpw_H8

Text Generation • Updated Apr 2 • 6

Mawdistical/Draconic-Tease-70B_EXL2_2.5bpw_H8

Updated Apr 7 • 3

Mawdistical/Vulpine-Seduction-70B_EXL2_2.5bpw_H8

Updated Apr 9 • 3

ReadyArt/Retrograde-Omega-M-22B-v1.0_EXL2_2.5bpw_H8

Text Generation • Updated Apr 10 • 6