---
license: mit
tags:
- Text Classification
- Transformers
- PyTorch
- JAX
- MSR
- English
- roberta
- Inference Endpoints
metrics:
- accuracy
pipeline_tag: text-classification
---

I finetuned a RobertaForSequenceClassification model which is initialized 
from CodeBert [https://huggingface.co/microsoft/codebert-base] to judge whether a code is vulnerable or not.
I selected balanced samples from MSR dataset [https://github.com/ZeoVan/MSR_20_Code_vulnerability_CSV_Dataset] for training, validation, and testing.
The "func_before" is used for code classification. All the data is in the file "msr.csv".

Test Reulsts: 
acc 0.7022935779816514, f1 0.6482384823848238,  precision 0.7920529801324503, recall 0.5486238532110091