[Feature] support W8A8(FP8) and KV Cache FP8 for DeepSeek V2 #1156
Description
Checklist
- 1. If the issue you raised is not a feature but a question, please raise a discussion at https://github.com/sgl-project/sglang/discussions/new/choose Otherwise, it will be closed.
- 2. Please use English, otherwise it will be closed.
Motivation
As titled. Make DeepSeek V2 MLA Faster!
Related resources
No response