Update README.md
Browse files
README.md
CHANGED
@@ -13,7 +13,7 @@ pipeline_tag: question-answering
|
|
13 |
|
14 |
# PurelyUnfunctionalAI/GibberishGPT
|
15 |
|
16 |
-
A lightweight decoder-only transformer language model trained with Flash Attention on the WikiText dataset. This is a version used for learning about training LLMs and ML pipelines.
|
17 |
<a href="https://github.com/PUFAI/GibberishGPT"> <img alt="GitHub" src="https://img.shields.io/badge/GitHub-Repo-blue?logo=github&style=flat-square"> </a>
|
18 |
|
19 |
## Model Details
|
|
|
13 |
|
14 |
# PurelyUnfunctionalAI/GibberishGPT
|
15 |
|
16 |
+
A lightweight decoder-only transformer language model trained with Flash Attention on the WikiText dataset. This is a version used for learning about training LLMs and ML pipelines. The model does not actually output coherent text, although serves as a good starting point for learning more about LLMs
|
17 |
<a href="https://github.com/PUFAI/GibberishGPT"> <img alt="GitHub" src="https://img.shields.io/badge/GitHub-Repo-blue?logo=github&style=flat-square"> </a>
|
18 |
|
19 |
## Model Details
|