LinyingLyu commited on
Commit
7e62517
·
verified ·
1 Parent(s): 10b4bfb

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +3 -3
README.md CHANGED
@@ -28,11 +28,11 @@ All models in the series achieve **HellaSwag benchmark scores that surpass those
28
  **ChronoGPT** has the following features:
29
  - Type: Causal Language Models
30
  - Training Stage: Pretraining
31
- - Number of Parameters: ~124 Million
32
- - Encoder & Decoder Partitioning: 6 encoder and 6 decoder layers
33
  - Tokenizer: GPT2Tokenizer from HuggingFace
34
  - Context Length: 1,792
35
- - Embedding Dimension: 768
36
 
37
  ## 🚀 Quickstart
38
 
 
28
  **ChronoGPT** has the following features:
29
  - Type: Causal Language Models
30
  - Training Stage: Pretraining
31
+ - Number of Parameters: ~1,552 Million
32
+ - Encoder & Decoder Partitioning: 26 encoder and 26 decoder layers
33
  - Tokenizer: GPT2Tokenizer from HuggingFace
34
  - Context Length: 1,792
35
+ - Embedding Dimension: 1,536
36
 
37
  ## 🚀 Quickstart
38