Ahmadzei's picture
update 1
57bdca5
raw
history blame
233 Bytes
The attention mask is a binary tensor indicating the
position of the padded indices so that the model does not attend to them. For the [BertTokenizer], 1 indicates a
value that should be attended to, while 0 indicates a padded value.