Q3 30b A3b Pentiment - GPTQ
Collection
GPTQ quants made with both GPTQModel and Autoround (PSA, may not work ootb in vLLM --- working on it)
•
3 items
•
Updated
No model card
- Downloads last month
- 13
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support