Hugging Face's logo

Alibaba-NLP
/
new-impl

Model card Files Community
11

Is flash-attention-2 suppported

#8
by Jack7777777 - opened
Discussion
Jack7777777

See it been commented out now: https://huggingface.co/Alibaba-NLP/new-impl/blob/main/modeling.py#L592

izhx
 Alibaba-NLP org

Hi, xformers could dispatch to flash-attention-2 kernel. Hence I commented out this extra entrance.

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment