michaelgathara commited on
Commit
5579881
verified
1 Parent(s): 76b84ed

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -13,7 +13,7 @@ pipeline_tag: question-answering
13
 
14
  # PurelyUnfunctionalAI/GibberishGPT
15
 
16
- A lightweight decoder-only transformer language model trained with Flash Attention on the WikiText dataset. This is a version used for learning about training LLMs and ML pipelines.
17
  <a href="https://github.com/PUFAI/GibberishGPT"> <img alt="GitHub" src="https://img.shields.io/badge/GitHub-Repo-blue?logo=github&style=flat-square"> </a>
18
 
19
  ## Model Details
 
13
 
14
  # PurelyUnfunctionalAI/GibberishGPT
15
 
16
+ A lightweight decoder-only transformer language model trained with Flash Attention on the WikiText dataset. This is a version used for learning about training LLMs and ML pipelines. The model does not actually output coherent text, although serves as a good starting point for learning more about LLMs
17
  <a href="https://github.com/PUFAI/GibberishGPT"> <img alt="GitHub" src="https://img.shields.io/badge/GitHub-Repo-blue?logo=github&style=flat-square"> </a>
18
 
19
  ## Model Details