[PD] transfer engine remove the metadata server. #5394

doujiang24 · 2025-04-15T01:58:50Z

Motivation

Make PD easier to use

retire the metadata server configuration, rely on the new p2phandshake feature in Mooncake transfer engine

Format your code according to the Code Formatting with Pre-Commit.
Add unit tests as outlined in the Running Unit Tests.
Update documentation / docstrings / example tutorials as needed, according to Writing Documentation.
Provide throughput / latency benchmark results and accuracy evaluation results as needed, according to Benchmark and Profiling and Accuracy Results.
For reviewers: If you haven't made any contributions to this PR and are only assisting with merging the main branch, please remove yourself as a co-author when merging the PR.
Please feel free to join our Slack channel at https://slack.sglang.ai to discuss your PR.

Signed-off-by: doujiang24 <doujiang24@gmail.com>

doujiang24 · 2025-04-16T16:03:39Z

already included in #5460, closing it, thanks @ShangmingCai for pushing forward.

[PD] transfer engine remove the metadata server.

1633c68

Signed-off-by: doujiang24 <doujiang24@gmail.com>

doujiang24 requested review from merrymercy, Ying1123, hnyls2002, zhyncs, ispobock and ByronHsu as code owners April 15, 2025 01:58

doujiang24 marked this pull request as draft April 15, 2025 01:58

use get_rpc_port for random rpc port.

ac08216

Signed-off-by: doujiang24 <doujiang24@gmail.com>

ShangmingCai mentioned this pull request Apr 16, 2025

[PD] Remove the requirement of config file for mooncake backend #5460

Merged

6 tasks

doujiang24 closed this Apr 16, 2025