DavieLion commited on
Commit
f796432
·
verified ·
1 Parent(s): bc1a379

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -22
README.md CHANGED
@@ -1,40 +1,30 @@
1
  ---
2
  base_model:
3
- - DavieLion/Lllma-3.2-1B
4
  tags:
5
  - alignment-handbook
6
  - generated_from_trainer
7
  datasets:
8
- - DavieLion/SPIN_iter0
9
  model-index:
10
- - name: iter0-ckpt
11
  results: []
12
- license: apache-2.0
13
  ---
14
 
15
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
16
  should probably proofread and complete it, then remove this comment. -->
17
 
18
- # iter0-ckpt
19
 
20
- This model is a fine-tuned version of [DavieLion/Lllma-3.2-1B](https://huggingface.co/DavieLion/Lllma-3.2-1B) on the DavieLion/SPIN_iter0 dataset.
21
 
22
  ## Model description
23
 
24
  - Model type: A 1B parameter GPT-like model fine-tuned on synthetic datasets.
25
  - Language(s) (NLP): Primarily English
26
- - License: Apache License 2.0
27
- - Finetuned from model: DavieLion/Lllma-3.2-1B (based on meta/Llama-3.2-1B)
28
-
29
- ## Intended uses & limitations
30
-
31
- More information needed
32
-
33
- ## Training and evaluation data
34
-
35
- More information needed
36
-
37
- ## Training procedure
38
 
39
  ### Training hyperparameters
40
 
@@ -53,10 +43,6 @@ The following hyperparameters were used during training:
53
  - lr_scheduler_warmup_ratio: 0.1
54
  - num_epochs: 6.0
55
 
56
- ### Training results
57
-
58
-
59
-
60
  ### Framework versions
61
 
62
  - Transformers 4.37.0
 
1
  ---
2
  base_model:
3
+ - meta-llama/Llama-3.2-1B
4
  tags:
5
  - alignment-handbook
6
  - generated_from_trainer
7
  datasets:
8
+ - HuggingFaceH4/ultrachat_200k
9
  model-index:
10
+ - name: Llama-3.2-1B-SPIN-iter0
11
  results: []
12
+ license: llama3.2
13
  ---
14
 
15
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
16
  should probably proofread and complete it, then remove this comment. -->
17
 
18
+ # Llama-3.2-1B-SPIN-iter3
19
 
20
+ This model is a fine-tuned version of [meta-llama/Llama-3.2-1B](https://huggingface.co/meta-llama/Llama-3.2-1B) on the [HuggingFaceH4/ultrachat_200k](https://huggingface.co/datasets/HuggingFaceH4/ultrachat_200k) datasets.
21
 
22
  ## Model description
23
 
24
  - Model type: A 1B parameter GPT-like model fine-tuned on synthetic datasets.
25
  - Language(s) (NLP): Primarily English
26
+ - License: Llama 3.2 Community Lisense Agreement
27
+ - Finetuned from model: meta-llama/Llama-3.2-1B
 
 
 
 
 
 
 
 
 
 
28
 
29
  ### Training hyperparameters
30
 
 
43
  - lr_scheduler_warmup_ratio: 0.1
44
  - num_epochs: 6.0
45
 
 
 
 
 
46
  ### Framework versions
47
 
48
  - Transformers 4.37.0