Does anyone feel Qwen3 often fails to follow instructions accurately?

#18
by DOFOFFICIAL - opened

Does anyone feel Qwen3 often fails to follow instructions accurately?

Like, I asked it to write code to numerically solve some problems but it always tries to mathematically derive it. I asked to numerically solve since it does not exist an analytical solution.
But qwen3 just keeps reasoning and saying "Well,,," "But,..." "Wait,,,"

It's like,,,, benchmark oriented? :( like llama4?

i think qwq 32b is much better in instruction following

I feel it is really good at instructions as I have been testing on my rag chatbot project. It performs really well when i make the instruction more precise.
Previously I used Mistral-7B-Instruct-v0.3 which is like dogsh*t compared to qwen3 when it comes to answers.

"i think qwq 32b is much better in instruction following"

Yeah, same for me

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment