Qwen
/

Text Generation
GGUF
English
chat
conversational

llama-server

#7
by kik - opened

Hi guys 👋

Thanks for QwQ, it has become one of my main coding models, with Qwen. You guys rock!

I was wondering: could you provide recommended parameters for llama-server as you did for llama-cli? They don't take exactly the same parameters, and even trying to copy those from llama-cli as well as I can, I still have quality and repetition issues when using llama-server.

Thanks!

请介绍下你自己

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment