Severe summarization issues
#3
by
notafraud
- opened
In prompts that ask for documents with a large number of entries, Mistral 3.2 (and Magistral - and that's why I assume that they share dataset) cut off after a few entries instead of writing the entire document as instructed, adding something like:
*(Continued for remaining 12 events, following the same format.)*
This, paired with frequent summarizations in other results, both creative and not, shows that your new dataset has an issue with summarization bias. System prompts don't fix the issue.