Update README.md
Browse files
README.md
CHANGED
|
@@ -18,7 +18,7 @@ pipeline_tag: text-generation
|
|
| 18 |
- Use Llama 3, see issues
|
| 19 |
|
| 20 |
# Issues
|
| 21 |
-
- Context length is not defined correctly in quant, not sure if this is a llama.cpp issue
|
| 22 |
- Output ends with </s> or other EOS tokens, might be an issue with their training data
|
| 23 |
|
| 24 |
This model was converted to GGUF format from [`gradientai/Llama-3-8B-Instruct-Gradient-4194k`](https://huggingface.co/gradientai/Llama-3-8B-Instruct-Gradient-4194k) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
|
|
|
|
| 18 |
- Use Llama 3, see issues
|
| 19 |
|
| 20 |
# Issues
|
| 21 |
+
- ~~Context length is not defined correctly in quant, not sure if this is a llama.cpp issue~~ Use RoPE settings
|
| 22 |
- Output ends with </s> or other EOS tokens, might be an issue with their training data
|
| 23 |
|
| 24 |
This model was converted to GGUF format from [`gradientai/Llama-3-8B-Instruct-Gradient-4194k`](https://huggingface.co/gradientai/Llama-3-8B-Instruct-Gradient-4194k) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
|