| license: apache-2.0 | |
| language: | |
| - ru | |
| - en | |
| - zh | |
| library_name: transformers | |
| DONT TOUCH, under dev | |
| |Task |Version| Metric |Value | |Stderr| | |
| |-----|------:|--------|-----:|---|-----:| | |
| |parus| 0|acc |0.4950|± |0.0250| | |
| |rcb | 0|acc |0.3333|± |0.0226| | |
| | | |f1_macro|0.1667| | | | |
| |rwsd | 0|acc |0.4901|± |0.0203| | |
| |mmlu| 0| 0.31|0.225| | |
| Based on https://huggingface.co/openbmb/MiniCPM-2B-sft-bf16 | |
| https://wandb.ai/alexwortega/cpm_rus/runs/32w8pv7x?workspace=user-alexwortega | |
| lol |