eos_token_id for that architecture must be 151645, check out https://huggingface.co/Qwen/QwQ-32B/blob/main/config.json

trashpanda org

Thanks!

Hasnonname changed pull request status to merged

Sign up or log in to comment