Update README.md
Browse files
README.md
CHANGED
@@ -23,7 +23,7 @@ My last iteration of fantasy writer suffered from one glaring flaw: It did not r
|
|
23 |
After much consideration, I decided it would make sense to introduce some information about the story chapter text
|
24 |
somewhere to link instructions to the text generated.
|
25 |
|
26 |
-
For this, I took strides of 16,384 tokens across each of the books, and used R1 to generate a summary of the text. With
|
27 |
some careful modification, I used this to generate the first user turn. Each subsequent assistant turn takes approximately
|
28 |
512 tokens of content, and then the user turn is a chapter header, or one paragraph of content. This alternated until I
|
29 |
consumed the entirity of the original stride.
|
|
|
23 |
After much consideration, I decided it would make sense to introduce some information about the story chapter text
|
24 |
somewhere to link instructions to the text generated.
|
25 |
|
26 |
+
For this, I took strides of 16,384 tokens across each of the books in the ~140M token dataset, and used R1 to generate a summary of the text. With
|
27 |
some careful modification, I used this to generate the first user turn. Each subsequent assistant turn takes approximately
|
28 |
512 tokens of content, and then the user turn is a chapter header, or one paragraph of content. This alternated until I
|
29 |
consumed the entirity of the original stride.
|