legolasyiu commited on
Commit
5193000
·
verified ·
1 Parent(s): d9c1210

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -107,8 +107,8 @@ Data used for model training and how the data was processed.
107
 
108
  ### Training Dataset
109
 
110
- Using Gemma as the base model, Athene CodeGemma 2 7B pretrained variants are further trained on an additional 500 billion tokens of primarily English language data from publicly available code repositories, open source mathematics datasets and synthetically generated code.
111
-
112
  ### Example: Athene CodeGemma 2 7B v1.1
113
  Athene CodeGemma 2 7B v1.1 successfully created snake game without errors compare to original codegemma-7b-it
114
 
 
107
 
108
  ### Training Dataset
109
 
110
+ Supervised Fine-tuning with coding datasets.
111
+
112
  ### Example: Athene CodeGemma 2 7B v1.1
113
  Athene CodeGemma 2 7B v1.1 successfully created snake game without errors compare to original codegemma-7b-it
114