Skip to content

Conversation

slin1237
Copy link
Collaborator

@slin1237 slin1237 commented Aug 1, 2025

Motivation

  • fix router prefill url parser so bootstrap port is fully not required

Modifications

  • launch router's prefill url parser

Test

python3 -m sglang_router.launch_router \
            --pd-disaggregation \
            --policy power_of_two \
            --prefill http://127.0.0.1:30001 \
            --decode http://127.0.0.8:30008 \
            --host 127.0.0.9 \
            --port 8000
2025-08-01 00:41:58  INFO sglang_router_rs::server: src/server.rs:265: Starting router on 127.0.0.9:8000 | mode: PrefillDecode { prefill_urls: [("http://127.0.0.1:30001", None)], decode_urls: ["http://127.0.0.8:30008"], prefill_policy: None, decode_policy: None } | policy: PowerOfTwo { load_check_interval_secs: 5 } | max_payload: 256MB

Accuracy Test

Benchmark & Profiling

Checklist

@slin1237 slin1237 requested a review from ByronHsu as a code owner August 1, 2025 00:42
Copy link
Contributor

Warning

You have reached your daily quota limit. Please wait up to 24 hours and I will start processing your requests again!

@zhyncs zhyncs merged commit 2886e23 into main Aug 1, 2025
22 checks passed
@zhyncs zhyncs deleted the slin/bug-fix-router branch August 1, 2025 01:09
Copy link
Contributor

Warning

You have reached your daily quota limit. Please wait up to 24 hours and I will start processing your requests again!

huangzhilin-hzl pushed a commit to huangzhilin-hzl/sglang that referenced this pull request Aug 1, 2025
TianQiLin666666 pushed a commit to TianQiLin666666/sglang that referenced this pull request Aug 1, 2025
narutolhy pushed a commit to narutolhy/sglang that referenced this pull request Aug 17, 2025
narutolhy pushed a commit to narutolhy/sglang that referenced this pull request Aug 18, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants