Skip to content

Conversation

hnyls2002
Copy link
Collaborator

@hnyls2002 hnyls2002 commented Jan 10, 2024

Still in progress...

  • multi-turns with uniformly sampled length.
  • Fix sglArgument.
  • New sleep policy(and it works).
  • Long and short multi-turns benchmark.
  • Mixtral on 8xA10
  • Possible improvement about manager/model_rpc/backend_config

Copy link
Contributor

@merrymercy merrymercy left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Run this unit test

@merrymercy merrymercy merged commit 08ab2a1 into main Jan 15, 2024
@merrymercy merrymercy deleted the json-mt-bench branch January 15, 2024 08:49
@Rookie-Kai Rookie-Kai mentioned this pull request Aug 14, 2024
4 tasks
chunyuan-w added a commit to chunyuan-w/sglang that referenced this pull request May 28, 2025
chunyuan-w added a commit to chunyuan-w/sglang that referenced this pull request Jun 3, 2025
chunyuan-w added a commit to chunyuan-w/sglang that referenced this pull request Jun 17, 2025
chunyuan-w added a commit to chunyuan-w/sglang that referenced this pull request Jun 30, 2025
yichiche pushed a commit to yichiche/sglang that referenced this pull request Jul 7, 2025
Signed-off-by: Ivan Butygin <ivan.butygin@gmail.com>
wangqian108 pushed a commit to wangqian108/sglang that referenced this pull request Jul 17, 2025
yichiche pushed a commit to yichiche/sglang that referenced this pull request Jul 23, 2025
Signed-off-by: Ivan Butygin <ivan.butygin@gmail.com>
yichiche pushed a commit to yichiche/sglang that referenced this pull request Jul 25, 2025
Signed-off-by: Ivan Butygin <ivan.butygin@gmail.com>
yichiche pushed a commit to yichiche/sglang that referenced this pull request Jul 30, 2025
Signed-off-by: Ivan Butygin <ivan.butygin@gmail.com>
yichiche pushed a commit to yichiche/sglang that referenced this pull request Aug 1, 2025
Signed-off-by: Ivan Butygin <ivan.butygin@gmail.com>
yichiche pushed a commit to yichiche/sglang that referenced this pull request Aug 6, 2025
Signed-off-by: Ivan Butygin <ivan.butygin@gmail.com>
yichiche pushed a commit to yichiche/sglang that referenced this pull request Aug 7, 2025
Signed-off-by: Ivan Butygin <ivan.butygin@gmail.com>
yichiche pushed a commit to yichiche/sglang that referenced this pull request Aug 11, 2025
Signed-off-by: Ivan Butygin <ivan.butygin@gmail.com>
yichiche pushed a commit to yichiche/sglang that referenced this pull request Aug 11, 2025
Signed-off-by: Ivan Butygin <ivan.butygin@gmail.com>
CatherineSue pushed a commit that referenced this pull request Aug 12, 2025
…d-on-v0.4.10.post2 (#10)

* Cherry-pick conflicts: features-based-on-v0.4.6.post5 → features-based-on-v0.4.7.post1 (#4)

* [Docker] Use local source file instead of git clone sglang (#4)

* [OAI] Support non-normalized logprobs in OpenAI server (#5961)

* feat: Improve Mistral and Qwen25 function call parsing (#6597)

* [Bugfix]: Fix call for function_call_parser.multi_format_detector in adapter.py (#6650)

* fix(tool call): Fix tool_index in PythonicDetector and issues with mixed output in non-streaming (#6678)

* bugfix(OAI): Fix image_data processing for jinja chat templates (#6877)

* compressed-tensors check_accelerate error need install accelerate

* Fix OOM in Llama4 with large images

* Fix lint

* ✅ Resolved: Cherry-pick

---------

Co-authored-by: Chao Yang <chao.c.yang@oracle.com>
Co-authored-by: Simo Lin <linsimo.mark@gmail.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

* ✅ Resolved: Cherry-pick from features-based-on-v0.4.7.post1 to features-based-on-v0.4.10.post2

* Delete openai_api folder

---------

Co-authored-by: Chao Yang <chao.c.yang@oracle.com>
Co-authored-by: Simo Lin <linsimo.mark@gmail.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
glenliu21 pushed a commit to glenliu21/sglang that referenced this pull request Aug 15, 2025
add check to assert that CFG requests can't be prefilled
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants