andysalerno commited on
Commit
3cb2c04
1 Parent(s): 519685f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -1
README.md CHANGED
@@ -23,4 +23,7 @@ Summary of versions:
23
  - 500 steps, filtered dataset to only include multi-chat-turn examples, used 4th ranking response as the "rejected" instead of 3rd, filtered out "good_natured=False", 5e-5 learning rate
24
 
25
  **[openchat-nectar-0.5](https://huggingface.co/andysalerno/openchat-nectar-0.5)**
26
- - 5000 steps (over a full epoch), filtered dataset to only include multi-chat-turn examples, used 4th ranking response as the "rejected" instead of 3rd, filtered out "good_natured=False", 5e-6 learning rate. Same as 0.4 but with 10x the steps, and 1/10th the learning rate
 
 
 
 
23
  - 500 steps, filtered dataset to only include multi-chat-turn examples, used 4th ranking response as the "rejected" instead of 3rd, filtered out "good_natured=False", 5e-5 learning rate
24
 
25
  **[openchat-nectar-0.5](https://huggingface.co/andysalerno/openchat-nectar-0.5)**
26
+ - 5000 steps (over a full epoch), filtered dataset to only include multi-chat-turn examples, used 4th ranking response as the "rejected" instead of 3rd, filtered out "good_natured=False", 5e-6 learning rate. Same as 0.4 but with 10x the steps, and 1/10th the learning rate
27
+
28
+ **[openchat-nectar-0.6](https://huggingface.co/andysalerno/openchat-nectar-0.6)**
29
+ - 500 steps, filtered dataset to only include multi-chat-turn examples, used 4th ranking response as the "rejected" instead of 3rd, filtered out "good_natured=False", 5e-5 learning rate. Same as 0.5 but with 1/10th the steps, and 10x the learning rate