Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Posts
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

Edit Models filters

Inference Providers
Fireworks
Nscale
Together AI
Replicate
Nebius AI Studio
Cerebras
Cohere
fal
Hyperbolic
SambaNova
Novita
HF Inference API
Misc
4.5-bit
Inference Endpoints
text-generation-inference
Merge

Misc with no match

Eval Results
4-bit precision
custom_code
8-bit precision
text-embeddings-inference
Carbon Emissions
Mixture of Experts

Models

10
Full-text search
Active filters: 4.5-bit

ReadyArt/Scrivener-Base-V3-LLaMA-70B_EXL2_4.5bpw_H8

Text Generation • Updated Mar 27 • 4

ReadyArt/Anathema-V2-LLaMA-70B_EXL2_4.5bpw_H8

Text Generation • Updated Mar 27 • 3

Mawdistical/Feline-Clairvoyance-72B_EXL2_4.5bpw_H8

Updated Mar 29

ReadyArt/Forgotten-Abomination-70B-v5.0_EXL2_4.5bpw_H8

Text Generation • Updated Mar 30 • 3

Mawdistical/Wanton-Wolf-70B_EXL2_4.5bpw_H8

Updated Mar 30

ReadyArt/Gaslight-24B-v1.0_EXL2_4.5bpw_H8

Text Generation • Updated Apr 2 • 3

ReadyArt/Gaslit-Transgression-24B-v1.0_EXL2_4.5bpw_H8

Text Generation • Updated Apr 2 • 2

Mawdistical/Draconic-Tease-70B_EXL2_4.5bpw_H8

Updated Apr 7 • 2

Mawdistical/Vulpine-Seduction-70B_EXL2_4.5bpw_H8

Updated Apr 9 • 4

ReadyArt/Retrograde-Omega-M-22B-v1.0_EXL2_4.5bpw_H8

Text Generation • Updated Apr 10 • 5
Company
TOS Privacy About Jobs
Website
Models Datasets Spaces Pricing Docs