Skip to content

Conversation

Fridge003
Copy link
Collaborator

Motivation

There are issues like #3704 #3537 that get confused with enable-ep-moe and ep-size arguments. This PR helps to clarify these arguments.

Also, we figured out cublas feature cannot be applied to SGLang effectively, so this part of doc should be removed.

Modifications

  • Put enable-ep-moe and ep-size together under EP part of server_args.md and get them clarified.
  • Remove Cublas Grouped Gemm part of deepseek.md

Checklist

@zhyncs zhyncs merged commit ac05310 into sgl-project:main Feb 20, 2025
11 of 12 checks passed
@Fridge003 Fridge003 deleted the doc branch February 21, 2025 03:57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants