Skip to content

Expert distribution recording without overhead for EPLB #4957

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 285 commits into from
May 20, 2025
Merged

Expert distribution recording without overhead for EPLB #4957

merged 285 commits into from
May 20, 2025

Conversation

fzyzcjy
Copy link
Collaborator

@fzyzcjy fzyzcjy commented Apr 1, 2025 •
edited
Loading

Motivation

For EPLB, and also for debugging/knowing details

dep: #5219

NOTE: There are enhancements to this, but it currently in branch #5295 and not yet extracted to here.

Modifications

Checklist

This was referenced May 18, 2025
Closed
Merged
Merged
Merged
@fzyzcjy fzyzcjy mentioned this pull request May 18, 2025
Merged
6 tasks
@fzyzcjy fzyzcjy mentioned this pull request May 20, 2025
Closed
6 tasks
@fzyzcjy
Copy link
Collaborator Author

fzyzcjy commented May 20, 2025 

➜  misc (cd /host_home/primary_synced/sglang && SGL_DISABLE_TP_MEMORY_INBALANCE_CHECK=1 python3 test/srt/test_full_deepseek_v3.py)
➜  misc (cd /host_home/primary_synced/sglang && SGL_DISABLE_TP_MEMORY_INBALANCE_CHECK=1 python3 test/srt/test_disaggregation_different_tp.py)

image

image

@zhyncs zhyncs merged commit f065388 into sgl-project:main May 20, 2025
1 of 42 checks passed
Layssy pushed a commit to Layssy/sglang-iaas that referenced this pull request Jun 9, 2025
@fzyzcjy @Layssy
Expert distribution recording without overhead for EPLB (sgl-project#…
03a0765 
…4957)
xwu-intel pushed a commit to xwu-intel/sglang that referenced this pull request Jun 17, 2025
@fzyzcjy @xwu-intel
Expert distribution recording without overhead for EPLB (sgl-project#…
f9b978b 
…4957)
Yuechguo pushed a commit to Yuechguo/sglang that referenced this pull request Jul 29, 2025
@fzyzcjy @Yuechguo
Expert distribution recording without overhead for EPLB (sgl-project#…
ac5c89d 
…4957)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@yizhang2077 yizhang2077 yizhang2077 approved these changes

@merrymercy merrymercy Awaiting requested review from merrymercy merrymercy is a code owner

@Ying1123 Ying1123 Awaiting requested review from Ying1123 Ying1123 is a code owner

@zhyncs zhyncs Awaiting requested review from zhyncs zhyncs is a code owner

@hnyls2002 hnyls2002 Awaiting requested review from hnyls2002 hnyls2002 is a code owner

@ispobock ispobock Awaiting requested review from ispobock ispobock is a code owner

@ByronHsu ByronHsu Awaiting requested review from ByronHsu

@xiezhq-hermann xiezhq-hermann Awaiting requested review from xiezhq-hermann xiezhq-hermann is a code owner

@HaiShaw HaiShaw Awaiting requested review from HaiShaw HaiShaw is a code owner

@zhaochenyang20 zhaochenyang20 Awaiting requested review from zhaochenyang20

@ch-wan ch-wan Awaiting requested review from ch-wan ch-wan is a code owner

@HandH1998 HandH1998 Awaiting requested review from HandH1998

@BBuf BBuf Awaiting requested review from BBuf BBuf is a code owner

@FlamingoPg FlamingoPg Awaiting requested review from FlamingoPg

@slin1237 slin1237 Awaiting requested review from slin1237

@rkooo567 rkooo567 Awaiting requested review from rkooo567

@kssteven418 kssteven418 Awaiting requested review from kssteven418

@CatherineSue CatherineSue Awaiting requested review from CatherineSue

@Fridge003 Fridge003 Awaiting requested review from Fridge003

Assignees

@yizhang2077 yizhang2077

@ch-wan ch-wan

Labels
high priority
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
6 participants
@fzyzcjy @ZJLi2013 @yizhang2077 @merrymercy @zhyncs @ch-wan