Hi! Basically what the title says.. Is vLLM support planned? Thanks.
Yes, vLLM is in progress. Hope we could roll it out as early as possible.
· Sign up or log in to comment