Triangle104 commited on
Commit
86a8be1
·
verified ·
1 Parent(s): c1f48c3

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +12 -0
README.md CHANGED
@@ -13,6 +13,18 @@ tags:
13
  This model was converted to GGUF format from [`nvidia/Llama-3.1-8B-UltraLong-2M-Instruct`](https://huggingface.co/nvidia/Llama-3.1-8B-UltraLong-2M-Instruct) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
14
  Refer to the [original model card](https://huggingface.co/nvidia/Llama-3.1-8B-UltraLong-2M-Instruct) for more details on the model.
15
 
 
 
 
 
 
 
 
 
 
 
 
 
16
  ## Use with llama.cpp
17
  Install llama.cpp through brew (works on Mac and Linux)
18
 
 
13
  This model was converted to GGUF format from [`nvidia/Llama-3.1-8B-UltraLong-2M-Instruct`](https://huggingface.co/nvidia/Llama-3.1-8B-UltraLong-2M-Instruct) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
14
  Refer to the [original model card](https://huggingface.co/nvidia/Llama-3.1-8B-UltraLong-2M-Instruct) for more details on the model.
15
 
16
+ ---
17
+ We introduce UltraLong-8B, a series of ultra-long
18
+ context language models designed to process extensive sequences of text
19
+ (up to 1M, 2M, and 4M tokens) while maintaining competitive performance
20
+ on standard benchmarks. Built on the Llama-3.1, UltraLong-8B leverages a
21
+ systematic training recipe that combines efficient continued
22
+ pretraining with instruction tuning to enhance long-context
23
+ understanding and instruction-following capabilities. This approach
24
+ enables our models to efficiently scale their context windows without
25
+ sacrificing general performance.
26
+
27
+ ---
28
  ## Use with llama.cpp
29
  Install llama.cpp through brew (works on Mac and Linux)
30