Update README.md
Browse files
README.md
CHANGED
@@ -13,6 +13,18 @@ tags:
|
|
13 |
This model was converted to GGUF format from [`nvidia/Llama-3.1-8B-UltraLong-2M-Instruct`](https://huggingface.co/nvidia/Llama-3.1-8B-UltraLong-2M-Instruct) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
|
14 |
Refer to the [original model card](https://huggingface.co/nvidia/Llama-3.1-8B-UltraLong-2M-Instruct) for more details on the model.
|
15 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
16 |
## Use with llama.cpp
|
17 |
Install llama.cpp through brew (works on Mac and Linux)
|
18 |
|
|
|
13 |
This model was converted to GGUF format from [`nvidia/Llama-3.1-8B-UltraLong-2M-Instruct`](https://huggingface.co/nvidia/Llama-3.1-8B-UltraLong-2M-Instruct) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
|
14 |
Refer to the [original model card](https://huggingface.co/nvidia/Llama-3.1-8B-UltraLong-2M-Instruct) for more details on the model.
|
15 |
|
16 |
+
---
|
17 |
+
We introduce UltraLong-8B, a series of ultra-long
|
18 |
+
context language models designed to process extensive sequences of text
|
19 |
+
(up to 1M, 2M, and 4M tokens) while maintaining competitive performance
|
20 |
+
on standard benchmarks. Built on the Llama-3.1, UltraLong-8B leverages a
|
21 |
+
systematic training recipe that combines efficient continued
|
22 |
+
pretraining with instruction tuning to enhance long-context
|
23 |
+
understanding and instruction-following capabilities. This approach
|
24 |
+
enables our models to efficiently scale their context windows without
|
25 |
+
sacrificing general performance.
|
26 |
+
|
27 |
+
---
|
28 |
## Use with llama.cpp
|
29 |
Install llama.cpp through brew (works on Mac and Linux)
|
30 |
|