completed training

.gitattributes

@@ -30,3 +30,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
 tokenizer.json filter=lfs diff=lfs merge=lfs -text
+pytorch_model.bin filter=lfs diff=lfs merge=lfs -text

README.md

@@ -1,12 +1,4 @@
 ---
-license: cc
-widget:
-  - text: "Movie: Parasite Score:"
-    example_title: "Parasite"
-  - text: "Movie: Come and See Score:"
-    example_title: "Come and See"
-  - text: "Movie: Harakiri Score:"
-    example_title: "Harakiri"
 tags:
 - generated_from_trainer
 model-index:
@@ -19,7 +11,9 @@ should probably proofread and complete it, then remove this comment. -->
 
 # ReviewTrainingBot
 
-This model was fine-tuned on GPT-2, using a dataset of ~120,000 reviews on letterboxd.com. The intention is to expand this dataset in the future, as well as upload the dataset to the Datasets collection. This is a work in progress.
+This model was trained from scratch on an unknown dataset.
+It achieves the following results on the evaluation set:
+- Loss: 2.9745
 
 ## Model description
 
@@ -38,16 +32,23 @@ More information needed
 ### Training hyperparameters
 
 The following hyperparameters were used during training:
-- learning_rate: 5e-05
-- train_batch_size: 4
-- eval_batch_size: 4
+- learning_rate: 0.001
+- train_batch_size: 10
+- eval_batch_size: 20
 - seed: 42
-- gradient_accumulation_steps: 5
-- total_train_batch_size: 20
+- distributed_type: multi-GPU
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
 - lr_scheduler_warmup_steps: 100
-- num_epochs: 5
+- training_steps: 5000
+
+### Training results
+
+| Training Loss | Epoch | Step | Validation Loss |
+|:-------------:|:-----:|:----:|:---------------:|
+| 2.9576        | 0.19  | 2000 | 3.0142          |
+| 2.9666        | 0.38  | 4000 | 2.9745          |
+
 
 ### Framework versions
 

config.json

@@ -40,7 +40,7 @@
     }
   },
   "torch_dtype": "float32",
-  "transformers_version": "4.21.2",
+  "transformers_version": "4.20.1",
   "use_cache": true,
   "vocab_size": 313696
 }

pytorch_model.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:b6f7334d0232d14b1be208e7a7edd64cd5347120d896754daf5b961d95491aa9
+oid sha256:e4e5c68f886f1c15b1a987f0999cde6e7b76b574a911e34e4f450b07c544dcf2
 size 1143253725

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:1af3a6ef9a02af062df1463008cc680ec5ad3709d84c04cbb17d454c853f98ed
+oid sha256:cdcb5bab7e2df84176238902483a596eb0b068ab32c9f3ba992175b3971ff3e4
 size 3311