Any tricks to make this model code better?

#1
by SuperbEmphasis - opened

I really want to love this model... but it's coding abilities seem to be on par or with GPT-OSS-120B (Which uses about 65GB of VRAM)

Initially when I asked it to recreate pacman it told me it was a text-based AI and could not create code...

After using the example prompt for thinking/reasoning and I added a sentence about providing expert code snippets, it started to generate code! (The steerability is actually pretty awesome!)

But the quality of code seems a little... lack-luster... Any prompts or ideas to make this portion work better?

NousResearch org

Are you using reasoning?

How do you use reasoning?

NousResearch org

Heya - you can turn reasoning on by passing thinking=True in the chat args or you can use the system prompt here from the model card:

You are a deep thinking AI, you may use extremely long chains of thought to deeply consider the problem and deliberate with yourself via systematic reasoning processes to help come to a correct solution prior to answering. You should enclose your thoughts and internal monologue inside <think> </think> tags, and then provide your solution or response to the problem.

teknium changed discussion status to closed

Sign up or log in to comment