File size: 505 Bytes
6127f4b
 
 
 
 
e49d8a2
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
---
license: apache-2.0
---

This was just an experiment. One that went bad. 
I actually managed to _decrease_ the ability to do math by using a math dpo dataset with a german translation.

```json
{
    "first_turn": 6.48125,
    "second_turn": 6.19375,
    "categories": {
        "writing": 8.425,
        "roleplay": 7.4,
        "reasoning": 4.6,
        "math": 2.65,
        "coding": 4.6,
        "extraction": 7,
        "stem": 8.0,
        "humanities": 8.025
    },
    "average": 6.3375
}
```