Granite 3 MoE 1B returns all 4's

#2
by AMead10 - opened

Every answer I have gotten from Granite 3 MoE (1B, 8-bit) has been all 4's. Example:

Q: linux set env vars

A: 44444444444444444

Hello, I tried to duplicate your situation but was unsuccessful. If you catch the model during evaluation, please share the screen. Also, maybe we'll be able to find someone else who has a similar problem.

The model is obtained directly from Ollama, and as long as I am testing it, it produces reasonable results.

(base) ksmd@arnold:~$ ollama -v
ollama version is 0.3.14
(base) ksmd@arnold:~$ ollama run granite3-moe:1b-instruct-q8_0
>>> What are the main differences between classical and modern art?
1. Medium: Classical art is typically painted on canvas or wood, while modern art can be anything from digital 
art to sculpture to performance pieces.

2. History: Classical art has a longer history, dating back thousands of years, while modern art emerged in the 
late 19th century and continues to evolve today.

3. Techniques: Classical artists used techniques such as oil painting, watercolor, and charcoal, while modern 
artists have access to a wide range of digital tools and materials.

4. Subject matter: Classical art often focused on religious or historical themes, while modern art encompasses a 
much wider range of subjects, including social issues, abstract concepts, and experimental forms.

5. Intent: Classical art was often created with a specific purpose in mind, such as documenting history or 
expressing emotion, while modern art is often more open-ended and exploratory.

>>> Send a message (/? for help)

image.png

image.png

I got it while testing the new voting implementation! In the code, the Granite MoE 1B is treated exactly the same as any other model. I will look into this issue further.

Sign up or log in to comment