400 on empty input_ids #4481

yinghai · 2025-03-16T20:57:20Z

Motivation

Bad input shouldn't cause the server to crash but rather we should error out.

Format your code according to the Code Formatting with Pre-Commit.
Add unit tests as outlined in the Running Unit Tests.
Update documentation / docstrings / example tutorials as needed, according to Writing Documentation.
Provide throughput / latency benchmark results and accuracy evaluation results as needed, according to Benchmark and Profiling and Accuracy Results.
For reviewers: If you haven't made any contributions to this PR and are only assisting with merging the main branch, please remove yourself as a co-author when merging the PR.
Please feel free to join our Slack channel at https://slack.sglang.ai to discuss your PR.

400 on empty input_ids

dad6eb1

yinghai requested review from merrymercy, Ying1123 and hnyls2002 as code owners March 16, 2025 20:57

zhyncs merged commit 799fb5f into sgl-project:main Mar 16, 2025
2 of 18 checks passed