File size: 1,113 Bytes
8b6b1b8 a9f22e0 8b6b1b8 f764586 9630065 ff7ee86 9630065 ff7ee86 9630065 c9fc3d5 9630065 ff7ee86 9630065 ff7ee86 d912336 8b6b1b8 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 |
---
license: mit
library_name: peft
---
## Training procedure
Generalization capabilities based on [this notebook](https://huggingface.co/AmelieSchreiber/esm2_t12_35M_lora_binding_sites_770K_v1/blob/main/esmbind-validation-notebook.ipynb)
are still lacking.
Test Metrics:
```python
'eval_loss': 0.4365999102592468,
'eval_accuracy': 0.9420512498988455,
'eval_precision': 0.2294216317399737,
'eval_recall': 0.7584797572261781,
'eval_f1': 0.35228549223252686,
'eval_auc': 0.8522129916967822,
'eval_mcc': 0.39725936154292724,
```
The metrics on the train and test datasets from the paper mentioned in
[this notebook](https://huggingface.co/AmelieSchreiber/esm2_t12_35M_lora_binding_sites_770K_v1/blob/main/esmbind-validation-notebook.ipynb) are:
```python
Train metrics:
Average Accuracy: 0.9169
Average Precision: 0.1416
Average Recall: 0.2769
Average F1 Score: 0.1743
Average AUC: 0.6088
Average MCC: 0.1522
Test metrics:
Average Accuracy: 0.9199
Average Precision: 0.1307
Average Recall: 0.2750
Average F1 Score: 0.1677
Average AUC: 0.6081
Average MCC: 0.1474
```
### Framework versions
- PEFT 0.5.0
|