psinger commited on
Commit
e8d5023
•
1 Parent(s): 71a4853

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -11,7 +11,7 @@ license: apache-2.0
11
 
12
  The following changes have been made:
13
  - Fixing generation configuration setting
14
- - Model now properly uses specified ```attention_mask``` when calling ```scaled_dot_product_attention``` - this also allows to specify custom attention masks and work with left-padded input.
15
 
16
 
17
  # 🚀 Falcon-7B
 
11
 
12
  The following changes have been made:
13
  - Fixing generation configuration setting
14
+ - Model now properly uses specified ```attention_mask``` when calling ```scaled_dot_product_attention``` - this also allows to specify custom attention masks and work with left-padded input. However, this will disable additional memory and flash optimization.
15
 
16
 
17
  # 🚀 Falcon-7B