Skip to content

Conversation

terrykong
Copy link
Contributor

Some models require testing a fix from vllm that's not in a released branch. This change adds a script that builds vllm as well as a guide that shows how to configure NeMo RL to use it

@github-actions github-actions bot added the documentation Improvements or additions to documentation label Jun 18, 2025
@terrykong terrykong force-pushed the tk/custom-vllm branch 2 times, most recently from d90118a to 9f163b1 Compare June 18, 2025 16:32
SahilJain314
SahilJain314 previously approved these changes Jun 27, 2025
@terrykong terrykong requested a review from jgerh June 28, 2025 03:57
Copy link
Contributor

@jgerh jgerh left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Completed tech pubs review and provided some suggested revisions

terrykong added 2 commits July 9, 2025 09:55
Signed-off-by: Terry Kong <terryk@nvidia.com>

script for debugging

Signed-off-by: Terry Kong <terryk@nvidia.com>

clean up

Signed-off-by: Terry Kong <terryk@nvidia.com>

add it into the index

Signed-off-by: Terry Kong <terryk@nvidia.com>

fix tutorial

Signed-off-by: Terry Kong <terryk@nvidia.com>

comment on why setuptools_scm

Signed-off-by: Terry Kong <terryk@nvidia.com>

clarify
Signed-off-by: Terry Kong <terryk@nvidia.com>

fix

Signed-off-by: Terry Kong <terryk@nvidia.com>

copyright

Signed-off-by: Terry Kong <terryk@nvidia.com>

Apply suggestions from code review

Co-authored-by: jgerh <163925524+jgerh@users.noreply.github.com>
Signed-off-by: Terry Kong <terrycurtiskong@gmail.com>

Apply suggestions from code review

Co-authored-by: jgerh <163925524+jgerh@users.noreply.github.com>
Signed-off-by: Terry Kong <terrycurtiskong@gmail.com>

Update docs/guides/use-custom-vllm.md

Signed-off-by: Terry Kong <terrycurtiskong@gmail.com>
Signed-off-by: Terry Kong <terryk@nvidia.com>
@terrykong terrykong added this pull request to the merge queue Jul 9, 2025
Merged via the queue into main with commit c5ee4a5 Jul 9, 2025
13 of 14 checks passed
@terrykong terrykong deleted the tk/custom-vllm branch July 9, 2025 19:08
RayenTian pushed a commit that referenced this pull request Jul 10, 2025
Signed-off-by: Terry Kong <terrycurtiskong@gmail.com>
Signed-off-by: Terry Kong <terryk@nvidia.com>
RayenTian pushed a commit that referenced this pull request Jul 10, 2025
Signed-off-by: Terry Kong <terrycurtiskong@gmail.com>
Signed-off-by: Terry Kong <terryk@nvidia.com>
RayenTian pushed a commit that referenced this pull request Jul 10, 2025
Signed-off-by: Terry Kong <terrycurtiskong@gmail.com>
Signed-off-by: Terry Kong <terryk@nvidia.com>
Signed-off-by: ruit <ruit@nvidia.com>
jialei777 pushed a commit to jialei777/nemo-rl that referenced this pull request Jul 23, 2025
Signed-off-by: Terry Kong <terrycurtiskong@gmail.com>
Signed-off-by: Terry Kong <terryk@nvidia.com>
Signed-off-by: Jialei Chen <jialeic@google.com>
KiddoZhu pushed a commit that referenced this pull request Jul 28, 2025
Signed-off-by: Terry Kong <terrycurtiskong@gmail.com>
Signed-off-by: Terry Kong <terryk@nvidia.com>
FannYYW pushed a commit to xxman-google/NeMo-RL that referenced this pull request Aug 5, 2025
Signed-off-by: Terry Kong <terrycurtiskong@gmail.com>
Signed-off-by: Terry Kong <terryk@nvidia.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
documentation Improvements or additions to documentation
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants