maldv commited on
Commit
f104aed
·
verified ·
1 Parent(s): 7ba226e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -23,7 +23,7 @@ My last iteration of fantasy writer suffered from one glaring flaw: It did not r
23
  After much consideration, I decided it would make sense to introduce some information about the story chapter text
24
  somewhere to link instructions to the text generated.
25
 
26
- For this, I took strides of 16,384 tokens across each of the books, and used R1 to generate a summary of the text. With
27
  some careful modification, I used this to generate the first user turn. Each subsequent assistant turn takes approximately
28
  512 tokens of content, and then the user turn is a chapter header, or one paragraph of content. This alternated until I
29
  consumed the entirity of the original stride.
 
23
  After much consideration, I decided it would make sense to introduce some information about the story chapter text
24
  somewhere to link instructions to the text generated.
25
 
26
+ For this, I took strides of 16,384 tokens across each of the books in the ~140M token dataset, and used R1 to generate a summary of the text. With
27
  some careful modification, I used this to generate the first user turn. Each subsequent assistant turn takes approximately
28
  512 tokens of content, and then the user turn is a chapter header, or one paragraph of content. This alternated until I
29
  consumed the entirity of the original stride.