PagedAttention

参考

• Hugging Face Conceptual Guides: PagedAttention <

• vLLM: Easy, Fast, and Cheap LLM Serving with PagedAttention