Update README.md
Browse files
README.md
CHANGED
@@ -33,9 +33,9 @@ set your (Max Tokens)context-lenght 16000t main-model, set your embedder-model (
|
|
33 |
|
34 |
-> ok what that mean!
|
35 |
|
36 |
-
you can receive
|
37 |
|
38 |
-
you can play and set for your needs, eg
|
39 |
|
40 |
16000t ~1GB VRAM usage
|
41 |
|
|
|
33 |
|
34 |
-> ok what that mean!
|
35 |
|
36 |
+
you can receive 14-snippets a 1024t (14336t) from your document ~10000words and 1600t left for the answer ~1000words
|
37 |
|
38 |
+
you can play and set for your needs, eg 8-snippets a 2048t, or 28-snippets a 512t ...
|
39 |
|
40 |
16000t ~1GB VRAM usage
|
41 |
|