File size: 1,113 Bytes
8b6b1b8
a9f22e0
8b6b1b8
 
 
 
f764586
9630065
ff7ee86
9630065
 
 
 
 
 
 
 
 
 
ff7ee86
9630065
c9fc3d5
 
9630065
 
 
ff7ee86
 
 
 
 
 
9630065
 
 
 
 
 
 
 
ff7ee86
 
d912336
8b6b1b8
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
---
license: mit
library_name: peft
---
## Training procedure

Generalization capabilities based on [this notebook](https://huggingface.co/AmelieSchreiber/esm2_t12_35M_lora_binding_sites_770K_v1/blob/main/esmbind-validation-notebook.ipynb)
are still lacking. 

Test Metrics:

```python
'eval_loss': 0.4365999102592468,
'eval_accuracy': 0.9420512498988455,
'eval_precision': 0.2294216317399737,
'eval_recall': 0.7584797572261781,
'eval_f1': 0.35228549223252686,
'eval_auc': 0.8522129916967822,
'eval_mcc': 0.39725936154292724,
```

The metrics on the train and test datasets from the paper mentioned in 
[this notebook](https://huggingface.co/AmelieSchreiber/esm2_t12_35M_lora_binding_sites_770K_v1/blob/main/esmbind-validation-notebook.ipynb) are:

```python
Train metrics: 
Average Accuracy: 0.9169
Average Precision: 0.1416
Average Recall: 0.2769
Average F1 Score: 0.1743
Average AUC: 0.6088
Average MCC: 0.1522

Test metrics: 
Average Accuracy: 0.9199
Average Precision: 0.1307
Average Recall: 0.2750
Average F1 Score: 0.1677
Average AUC: 0.6081
Average MCC: 0.1474
```


### Framework versions


- PEFT 0.5.0