Hastagaras commited on
Commit
f57d356
·
verified ·
1 Parent(s): a7a9791

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -26,8 +26,8 @@ And thanks for all the feedback from the previous model, it helps a lot. (I coul
26
  * Based on [this model](https://huggingface.co/Hastagaras/Jamet-8B-L3-MK.II-LV), and merge that with Llama 3 Instruct.
27
  * Next step is DPO! to reduce the cheerfulness and emoji, using around 1k prompts from alpaca to generate a dataset with the model, selecting the ones with emojis, removing the emojis using regex and moving those without emojis to the chosen, and the responses with emojis to the rejected.(With unsloth)
28
  * And then apply the [Abomination Lora from Blackroot](https://huggingface.co/Blackroot/Llama-3-8B-Abomination-LORA).
 
29
  * And then merge again with the Anjrit model (I don't release the model since it's very bad at longer context, I just want the storytelling ability but you can read small info of the model at my [Anjir model](https://huggingface.co/Hastagaras/Anjir-8B-L3)).
30
- * Next, apply [Anjir Adapter](https://huggingface.co/Hastagaras/ANJIR-ADAPTER-64) (64 Rank version with reduced Alpha to help with formatting).
31
 
32
  And that's it.
33
 
 
26
  * Based on [this model](https://huggingface.co/Hastagaras/Jamet-8B-L3-MK.II-LV), and merge that with Llama 3 Instruct.
27
  * Next step is DPO! to reduce the cheerfulness and emoji, using around 1k prompts from alpaca to generate a dataset with the model, selecting the ones with emojis, removing the emojis using regex and moving those without emojis to the chosen, and the responses with emojis to the rejected.(With unsloth)
28
  * And then apply the [Abomination Lora from Blackroot](https://huggingface.co/Blackroot/Llama-3-8B-Abomination-LORA).
29
+ * Next, apply [Anjir Adapter](https://huggingface.co/Hastagaras/ANJIR-ADAPTER-64) (64 Rank version with reduced Alpha to help with formatting while retaining the previous lora influence).
30
  * And then merge again with the Anjrit model (I don't release the model since it's very bad at longer context, I just want the storytelling ability but you can read small info of the model at my [Anjir model](https://huggingface.co/Hastagaras/Anjir-8B-L3)).
 
31
 
32
  And that's it.
33