Hugging Face's logo

mlfoundations-dev
/
openthoughts3_100k_llama3

Text Generation
Transformers
Safetensors
llama
llama-factory
full
Generated from Trainer
conversational
text-generation-inference
Model card Files
xet
Community
sedrickkeh commited on
Commit
782e233
·
verified ·
1 Parent(s): 2d34df0

End of training

Browse files
Files changed (5) hide show
  1. README.md +2 -1
  2. all_results.json +3 -3
  3. train_results.json +3 -3
  4. trainer_state.json +0 -0
  5. training_loss.png +0 -0
README.md CHANGED
@@ -4,6 +4,7 @@ license: llama3.1
4
  base_model: meta-llama/Llama-3.1-8B-Instruct
5
  tags:
6
  - llama-factory
 
7
  - generated_from_trainer
8
  model-index:
9
  - name: openthoughts3_100k_llama3
@@ -15,7 +16,7 @@ should probably proofread and complete it, then remove this comment. -->
15
 
16
  # openthoughts3_100k_llama3
17
 
18
- This model is a fine-tuned version of [meta-llama/Llama-3.1-8B-Instruct](https://huggingface.co/meta-llama/Llama-3.1-8B-Instruct) on an unknown dataset.
19
 
20
  ## Model description
21
 
 
4
  base_model: meta-llama/Llama-3.1-8B-Instruct
5
  tags:
6
  - llama-factory
7
+ - full
8
  - generated_from_trainer
9
  model-index:
10
  - name: openthoughts3_100k_llama3
 
16
 
17
  # openthoughts3_100k_llama3
18
 
19
+ This model is a fine-tuned version of [meta-llama/Llama-3.1-8B-Instruct](https://huggingface.co/meta-llama/Llama-3.1-8B-Instruct) on the mlfoundations-dev/openthoughts3_100k dataset.
20
 
21
  ## Model description
22
 
all_results.json CHANGED
@@ -1,8 +1,8 @@
1
  {
2
  "epoch": 4.98971898560658,
3
  "total_flos": 2.1065883137322516e+19,
4
- "train_loss": 1.0237522615836216,
5
- "train_runtime": 109255.8386,
6
- "train_samples_per_second": 4.272,
7
  "train_steps_per_second": 0.008
8
  }
 
1
  {
2
  "epoch": 4.98971898560658,
3
  "total_flos": 2.1065883137322516e+19,
4
+ "train_loss": 0.9554639947938395,
5
+ "train_runtime": 109130.9683,
6
+ "train_samples_per_second": 4.277,
7
  "train_steps_per_second": 0.008
8
  }
train_results.json CHANGED
@@ -1,8 +1,8 @@
1
  {
2
  "epoch": 4.98971898560658,
3
  "total_flos": 2.1065883137322516e+19,
4
- "train_loss": 1.0237522615836216,
5
- "train_runtime": 109255.8386,
6
- "train_samples_per_second": 4.272,
7
  "train_steps_per_second": 0.008
8
  }
 
1
  {
2
  "epoch": 4.98971898560658,
3
  "total_flos": 2.1065883137322516e+19,
4
+ "train_loss": 0.9554639947938395,
5
+ "train_runtime": 109130.9683,
6
+ "train_samples_per_second": 4.277,
7
  "train_steps_per_second": 0.008
8
  }
trainer_state.json CHANGED
The diff for this file is too large to render. See raw diff
 
training_loss.png CHANGED