Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
Edit Models filters
Tasks
Libraries
Datasets
Languages
Licenses
Other
1
Inference Providers
Select all
Replicate
Together AI
Nebius AI Studio
Cerebras
SambaNova
Fireworks
fal
Novita
Hyperbolic
Cohere
HF Inference API
Misc
Reset Misc
llm-compressor
AutoTrain Compatible
Inference Endpoints
text-generation-inference
Misc with no match
Eval Results
Merge
4-bit precision
8-bit precision
custom_code
text-embeddings-inference
Carbon Emissions
Mixture of Experts
Apply filters
Models
8
Full-text search
Edit filters
Sort: Trending
Active filters:
llm-compressor
Clear all
RedHatAI/Qwen2.5-0.5B-quantized.w8a16
Text Generation
•
Updated
Nov 26, 2024
•
31
RedHatAI/Qwen2.5-1.5B-quantized.w8a16
Text Generation
•
Updated
Nov 26, 2024
•
5
RedHatAI/Qwen2.5-3B-quantized.w8a16
Text Generation
•
Updated
Nov 26, 2024
•
2
RedHatAI/Qwen2.5-7B-quantized.w8a16
Text Generation
•
Updated
Nov 26, 2024
•
45
•
1
RedHatAI/Qwen2.5-32B-quantized.w8a16
Text Generation
•
Updated
Nov 26, 2024
•
21
RedHatAI/Qwen2.5-72B-quantized.w8a16
Text Generation
•
Updated
Nov 26, 2024
•
41
brokenlander/AlphaBuffett-FP8-Dynamic
Text Generation
•
Updated
Feb 16
divish/M-Prometheus-3B-FP8-Dynamic
Text Generation
•
Updated
5 days ago
•
1