HachiML commited on
Commit
6461dd4
·
verified ·
1 Parent(s): fdff5ec

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -13,8 +13,8 @@ should probably proofread and complete it, then remove this comment. -->
13
 
14
  # Bit-Llama2-jp-123M
15
 
16
- This model is a fine-tuned version of [TinyLlama/TinyLlama-1.1B-Chat-v1.0](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0) on an unknown dataset.
17
- It achieves the following results on the evaluation set:
18
  - Loss: 3.7091
19
 
20
  ## Model description
 
13
 
14
  # Bit-Llama2-jp-123M
15
 
16
+ This model was built by referring to the config in [TinyLlama/TinyLlama-1.1B-Chat-v1.0](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0), 123M The model is a pre-trained Bit-Llama2 of Parameters with only 1 epoch on a Japanese dataset.
17
+ The dataset used is [range3/wiki40b-en](https://huggingface.co/datasets/range3/wiki40b-ja).
18
  - Loss: 3.7091
19
 
20
  ## Model description