Skip to content

Conversation

jianshen92
Copy link
Contributor

What does this PR address?

Fixes #(issue)

Before submitting:

@jianshen92 jianshen92 requested a review from Sherlock113 May 7, 2025 10:32
@jianshen92 jianshen92 requested a review from a team as a code owner May 7, 2025 10:33
@jianshen92 jianshen92 requested review from aarnphm and removed request for a team May 7, 2025 10:33
Copy link
Contributor

hyperlint-ai bot commented May 7, 2025

PR Change Summary

Updated the description of the max_latency_ms parameter to clarify its role in the batch processing time.

  • Revised the definition of max_latency_ms to reflect its purpose as the total acceptable SLA for batch processing time.
  • Clarified that the dispatcher will use this value to predict processing time for batches.

Modified Files

  • docs/source/get-started/adaptive-batching.rst

How can I customize these reviews?

Check out the Hyperlint AI Reviewer docs for more information on how to customize the review.

If you just want to ignore it on this PR, you can add the hyperlint-ignore label to the PR. Future changes won't trigger a Hyperlint review.

Note specifically for link checks, we only check the first 30 links in a file and we cache the results for several hours (for instance, if you just added a page, you might experience this). Our recommendation is to add hyperlint-ignore to the PR to ignore the link check for this PR.

@aarnphm
Copy link
Contributor

aarnphm commented May 7, 2025

LGTM, but will def cc @Sherlock113

@Sherlock113 Sherlock113 merged commit 4f9db50 into bentoml:main May 13, 2025
6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants