just use for
vllm serve lee5j/Athene-V2-Chat-gptq4 --gpu-memory-utilization 1
- Downloads last month
- 1
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
馃檵
Ask for provider support
HF Inference deployability: The model has no library tag.