Kevin Ripper commited on
Commit
ff715d8
·
1 Parent(s): 9e2ddfb

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -16
README.md CHANGED
@@ -11,21 +11,16 @@ widget:
11
 
12
  # ReviewTrainingBot
13
 
14
- This model was trained from scratch on an unknown dataset.
15
- It achieves the following results on the evaluation set:
16
- - Loss: 2.9745
17
 
18
- ## Model description
19
-
20
- More information needed
21
 
22
  ## Intended uses & limitations
23
 
24
- More information needed
 
 
25
 
26
- ## Training and evaluation data
27
 
28
- More information needed
29
 
30
  ## Training procedure
31
 
@@ -42,13 +37,6 @@ The following hyperparameters were used during training:
42
  - lr_scheduler_warmup_steps: 100
43
  - training_steps: 5000
44
 
45
- ### Training results
46
-
47
- | Training Loss | Epoch | Step | Validation Loss |
48
- |:-------------:|:-----:|:----:|:---------------:|
49
- | 2.9576 | 0.19 | 2000 | 3.0142 |
50
- | 2.9666 | 0.38 | 4000 | 2.9745 |
51
-
52
 
53
  ### Framework versions
54
 
 
11
 
12
  # ReviewTrainingBot
13
 
14
+ This model was trained for the purpose of generating scores and reviews for any given movie. It is fine-tuned on distilgpt2 as a baseline and trained on a custom dataset created by scraping around 120k letterboxd reviews. The current state of the model can get the correct formatting reliably but oftentimes is prone to gibberish. Further training will hopefully add coherency.
 
 
15
 
 
 
 
16
 
17
  ## Intended uses & limitations
18
 
19
+ This model is intended to be used for entertainment.
20
+
21
+ Limitations for this model will be much of the same as distilgpt2 which can be viewed here https://huggingface.co/distilgpt2. These may include persistent biases. Another issue may be through language specifically on letterboxd that the algorithm may not be able to understand. i.e. an LGBT+ film on letterboxd may have multiple reviews that mention the word "gay" positively, this model has not been able to understand this contextual usage and will use the word as a slur. As the current model also struggles to find a connection between movie titles and the reviews, this could happen with any listed movie.
22
 
 
23
 
 
24
 
25
  ## Training procedure
26
 
 
37
  - lr_scheduler_warmup_steps: 100
38
  - training_steps: 5000
39
 
 
 
 
 
 
 
 
40
 
41
  ### Framework versions
42