Skip to content

[Feature] integrate FlashMLA #4384

@zhyncs

Description

@zhyncs

Checklist

Motivation

Since SGLang now supports page sizes greater than 1, we should integrate FlashMLA https://github.com/deepseek-ai/FlashMLA.

Related resources

No response

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions