Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
Edit Models filters
Tasks
Libraries
Datasets
Languages
Licenses
Other
1
Inference Providers
Select all
Fireworks
Nscale
Together AI
Replicate
Nebius AI Studio
Cerebras
Cohere
fal
Hyperbolic
SambaNova
Novita
HF Inference API
Misc
Reset Misc
4.5-bit
Inference Endpoints
text-generation-inference
Merge
Misc with no match
Eval Results
4-bit precision
custom_code
8-bit precision
text-embeddings-inference
Carbon Emissions
Mixture of Experts
Apply filters
Models
10
Full-text search
Edit filters
Sort: Trending
Active filters:
4.5-bit
Clear all
ReadyArt/Scrivener-Base-V3-LLaMA-70B_EXL2_4.5bpw_H8
Text Generation
•
Updated
Mar 27
•
4
ReadyArt/Anathema-V2-LLaMA-70B_EXL2_4.5bpw_H8
Text Generation
•
Updated
Mar 27
•
3
Mawdistical/Feline-Clairvoyance-72B_EXL2_4.5bpw_H8
Updated
Mar 29
ReadyArt/Forgotten-Abomination-70B-v5.0_EXL2_4.5bpw_H8
Text Generation
•
Updated
Mar 30
•
3
Mawdistical/Wanton-Wolf-70B_EXL2_4.5bpw_H8
Updated
Mar 30
ReadyArt/Gaslight-24B-v1.0_EXL2_4.5bpw_H8
Text Generation
•
Updated
Apr 2
•
3
ReadyArt/Gaslit-Transgression-24B-v1.0_EXL2_4.5bpw_H8
Text Generation
•
Updated
Apr 2
•
2
Mawdistical/Draconic-Tease-70B_EXL2_4.5bpw_H8
Updated
Apr 7
•
2
Mawdistical/Vulpine-Seduction-70B_EXL2_4.5bpw_H8
Updated
Apr 9
•
4
ReadyArt/Retrograde-Omega-M-22B-v1.0_EXL2_4.5bpw_H8
Text Generation
•
Updated
Apr 10
•
5