Had issues with some Q4_K quants getting NaN, making rest public for now, will fix others when I have a chance and upload them
- Downloads last month
- 162
Hardware compatibility
Log In
to view the estimation
1-bit
2-bit
3-bit
4-bit
6-bit
8-bit
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support