.. _flashattention:

======================
FlashAttention
======================

参考
======

- `Hugging Face Conceptual Guides: Flash Attention <https://huggingface.co/docs/text-generation-inference/conceptual/flash_attention>`_
- `Dao-AILab/flash-attention <https://github.com/dao-ailab/flash-attention>`_
- `FlashAttention-4: Algorithm and Kernel Pipelining Co-Design for Asymmetric Hardware Scaling <https://www.together.ai/blog/flashattention-4>`_