Update README.md
Browse files
README.md
CHANGED
|
@@ -34,14 +34,15 @@ Training Code can be found here: https://github.com/Saikat-M/LLM-Finetuning
|
|
| 34 |
* Code generation tasks
|
| 35 |
|
| 36 |
### Training Data
|
| 37 |
-
Dataset: https://huggingface.co/datasets/SaikatM/Code-Platypus
|
| 38 |
-
|
|
|
|
| 39 |
|
| 40 |
### Training Procedure
|
| 41 |
|
| 42 |
Used QLoRA from PEFT and used SFTTrainer.
|
| 43 |
|
| 44 |
-
#### Preprocessing
|
| 45 |
|
| 46 |
From the Open-Platypus dataset filtering-out rows which has leetcode_ne in it's data_source column.
|
| 47 |
|
|
@@ -93,7 +94,14 @@ Took around 1 hour to train.
|
|
| 93 |
|
| 94 |
### Results
|
| 95 |
|
| 96 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 97 |
|
| 98 |
### Compute Infrastructure
|
| 99 |
|
|
|
|
| 34 |
* Code generation tasks
|
| 35 |
|
| 36 |
### Training Data
|
| 37 |
+
* Dataset: https://huggingface.co/datasets/SaikatM/Code-Platypus
|
| 38 |
+
|
| 39 |
+
* Source Dataset: https://huggingface.co/datasets/garage-bAInd/Open-Platypus
|
| 40 |
|
| 41 |
### Training Procedure
|
| 42 |
|
| 43 |
Used QLoRA from PEFT and used SFTTrainer.
|
| 44 |
|
| 45 |
+
#### Preprocessing
|
| 46 |
|
| 47 |
From the Open-Platypus dataset filtering-out rows which has leetcode_ne in it's data_source column.
|
| 48 |
|
|
|
|
| 94 |
|
| 95 |
### Results
|
| 96 |
|
| 97 |
+
```<bos>Write a fucntion to sort a list in python.<eos>
|
| 98 |
+
|
| 99 |
+
Answer:
|
| 100 |
+
|
| 101 |
+
def sort_list(list):
|
| 102 |
+
return sorted(list)<eos>
|
| 103 |
+
Response: None
|
| 104 |
+
```
|
| 105 |
|
| 106 |
### Compute Infrastructure
|
| 107 |
|