silviasapora commited on
Commit
625956c
·
verified ·
1 Parent(s): 03a7947

End of training

Browse files
Files changed (1) hide show
  1. README.md +6 -3
README.md CHANGED
@@ -1,17 +1,20 @@
1
  ---
2
  base_model: mistralai/Mistral-7B-v0.3
 
 
3
  library_name: transformers
4
- model_name: mistral-7b-sft-basic-5e-5-000-v132
5
  tags:
6
  - generated_from_trainer
 
7
  - trl
8
  - orpo
9
  licence: license
10
  ---
11
 
12
- # Model Card for mistral-7b-sft-basic-5e-5-000-v132
13
 
14
- This model is a fine-tuned version of [mistralai/Mistral-7B-v0.3](https://huggingface.co/mistralai/Mistral-7B-v0.3).
15
  It has been trained using [TRL](https://github.com/huggingface/trl).
16
 
17
  ## Quick start
 
1
  ---
2
  base_model: mistralai/Mistral-7B-v0.3
3
+ datasets:
4
+ - argilla/dpo-mix-7k
5
  library_name: transformers
6
+ model_name: mistralai/Mistral-7B-v0.3
7
  tags:
8
  - generated_from_trainer
9
+ - alignment-handbook
10
  - trl
11
  - orpo
12
  licence: license
13
  ---
14
 
15
+ # Model Card for mistralai/Mistral-7B-v0.3
16
 
17
+ This model is a fine-tuned version of [mistralai/Mistral-7B-v0.3](https://huggingface.co/mistralai/Mistral-7B-v0.3) on the [['argilla/dpo-mix-7k']](https://huggingface.co/datasets/['argilla/dpo-mix-7k']) dataset.
18
  It has been trained using [TRL](https://github.com/huggingface/trl).
19
 
20
  ## Quick start