Cannot use FlashAttention-2 backend for head size 72.

#51
by jasstionzyf - opened

try to use flash attention but throw above error

Sign up or log in to comment