added SOS and EOS tokens
Browse files
README.md
CHANGED
|
@@ -43,7 +43,7 @@ tokenizer = PreTrainedTokenizerFast.from_pretrained(model_name)
|
|
| 43 |
3) Prepare your input. Below is a simple example describing fields under SU(2), U(1), and SU(3):
|
| 44 |
|
| 45 |
```python
|
| 46 |
-
input_text = "FIELD SPIN 0 SU2 2 U1 1 FIELD SPIN 1 / 2 SU3 3 SU2 2 U1 1 / 3 HEL - 1 / 2"
|
| 47 |
```
|
| 48 |
|
| 49 |
4) Perform generation:
|
|
|
|
| 43 |
3) Prepare your input. Below is a simple example describing fields under SU(2), U(1), and SU(3):
|
| 44 |
|
| 45 |
```python
|
| 46 |
+
input_text = "[SOS] FIELD SPIN 0 SU2 2 U1 1 FIELD SPIN 1 / 2 SU3 3 SU2 2 U1 1 / 3 HEL - 1 / 2 [EOS]"
|
| 47 |
```
|
| 48 |
|
| 49 |
4) Perform generation:
|