Hugging Face's logo

Alibaba-NLP
/
new-impl

Model card Files
xet
Community
13

Is flash-attention-2 suppported

#8
by Jack7777777 - opened
Discussion
Jack7777777

See it been commented out now: https://huggingface.co/Alibaba-NLP/new-impl/blob/main/modeling.py#L592
izhx
 Alibaba-NLP org

Hi, xformers could dispatch to flash-attention-2 kernel. Hence I commented out this extra entrance.

Sign up or log in to comment