synthetic_relex / performance_reports.md
jakelever's picture
Upload folder using huggingface_hub
91a5de2 verified

Performance on Training Set

Label Precision Recall F1-score Support
affects_efficacy_of 0.874 0.658 0.751 3282
binds_to 0.888 0.757 0.817 967
biomarker_for 0.760 0.918 0.831 1081
causes 0.913 0.842 0.876 10861
co_expressed_with 0.921 0.843 0.880 605
downregulates 0.888 0.905 0.896 744
inhibits 0.903 0.691 0.783 4565
interacts_with 0.883 0.785 0.831 3495
none 0.976 0.988 0.982 217028
plays_causal_role_in 0.739 0.833 0.783 926
precursor_of 0.926 0.763 0.836 379
prevents 0.842 0.835 0.838 423
regulates 0.784 0.837 0.809 454
subtype_of 0.697 0.839 0.761 939
treats 0.871 0.919 0.895 2592
upregulates 0.845 0.900 0.871 1077
macro avg 0.857 0.832 0.840 249418
weighted avg 0.964 0.964 0.963 249418

Performance on Validation Set

Label Precision Recall F1-score Support
affects_efficacy_of 0.466 0.252 0.327 994
binds_to 0.568 0.303 0.395 317
biomarker_for 0.476 0.626 0.541 441
causes 0.659 0.542 0.595 3513
co_expressed_with 0.574 0.251 0.350 370
downregulates 0.658 0.571 0.612 371
inhibits 0.502 0.319 0.390 1127
interacts_with 0.550 0.366 0.440 1385
none 0.931 0.960 0.946 70920
plays_causal_role_in 0.391 0.411 0.401 253
precursor_of 0.541 0.384 0.449 172
prevents 0.645 0.562 0.601 178
regulates 0.474 0.522 0.497 178
subtype_of 0.352 0.454 0.397 271
treats 0.650 0.657 0.654 866
upregulates 0.585 0.539 0.561 395
macro avg 0.564 0.483 0.510 81751
weighted avg 0.884 0.894 0.887 81751

Performance on Test Set

Label Precision Recall F1-score Support
affects_efficacy_of 0.473 0.296 0.364 1127
binds_to 0.541 0.266 0.357 492
biomarker_for 0.455 0.621 0.525 314
causes 0.667 0.571 0.615 3400
co_expressed_with 0.440 0.473 0.456 131
downregulates 0.472 0.481 0.477 106
inhibits 0.460 0.251 0.324 1429
interacts_with 0.469 0.310 0.373 1588
none 0.936 0.961 0.948 76442
plays_causal_role_in 0.343 0.426 0.380 202
precursor_of 0.462 0.212 0.291 113
prevents 0.602 0.504 0.548 135
regulates 0.504 0.509 0.506 116
subtype_of 0.382 0.521 0.441 286
treats 0.630 0.702 0.664 1000
upregulates 0.564 0.549 0.557 224
macro avg 0.525 0.478 0.489 87105
weighted avg 0.889 0.898 0.892 87105