Update README.md
Browse files
README.md
CHANGED
@@ -47,7 +47,7 @@ print("Inference results:", output)
|
|
47 |
```
|
48 |
In the finetuning file you will see our other optimizations.
|
49 |
|
50 |
-
We perform
|
51 |
```
|
52 |
model = GPT2LMHeadModel.from_pretrained('gpt2-medium').to(torch.bfloat16)
|
53 |
```
|
|
|
47 |
```
|
48 |
In the finetuning file you will see our other optimizations.
|
49 |
|
50 |
+
We perform BF16 conversion as follows (we also implement a custom collator):
|
51 |
```
|
52 |
model = GPT2LMHeadModel.from_pretrained('gpt2-medium').to(torch.bfloat16)
|
53 |
```
|