Update README.md
Browse files
README.md
CHANGED
|
@@ -35,7 +35,7 @@ license: apache-2.0
|
|
| 35 |
---
|
| 36 |
# Model Card for Teuken-7B-instruct-commercial-v0.4-16k-Context-FT-ChatML
|
| 37 |
|
| 38 |
-
|
| 39 |
|
| 40 |
[Teuken-7B-instruct-commercial-v0.4](https://huggingface.co/openGPT-X/Teuken-7B-instruct-commercial-v0.4) is an instruction-tuned 7B parameter multilingual large language model (LLM) pre-trained with 4T tokens in all official 24 European languages and released under Apache 2.0 in the research project [OpenGPT-X](https://opengpt-x.de).
|
| 41 |
The base model Teuken-7B-base-v0.4 is available on request 📧 <a href="[email protected]">[email protected]</a>.
|
|
|
|
| 35 |
---
|
| 36 |
# Model Card for Teuken-7B-instruct-commercial-v0.4-16k-Context-FT-ChatML
|
| 37 |
|
| 38 |
+
Finetuned Teuken with ChatML Template and Large Context Dataset to enhance Long-Context Tasks after extending the Context-Window without Rope-Scaling to 16k from [Teuken-7B-instruct-commercial-v0.4](https://huggingface.co/openGPT-X/Teuken-7B-instruct-commercial-v0.4)
|
| 39 |
|
| 40 |
[Teuken-7B-instruct-commercial-v0.4](https://huggingface.co/openGPT-X/Teuken-7B-instruct-commercial-v0.4) is an instruction-tuned 7B parameter multilingual large language model (LLM) pre-trained with 4T tokens in all official 24 European languages and released under Apache 2.0 in the research project [OpenGPT-X](https://opengpt-x.de).
|
| 41 |
The base model Teuken-7B-base-v0.4 is available on request 📧 <a href="[email protected]">[email protected]</a>.
|