Skip to content

Conversation

ETOgaosion
Copy link
Collaborator

Parts of #851

Including minimal of upgrade:

  1. vllm 0.8.2 with megatron
  2. part of per-tensor allgather and load weights
  3. fix bugs with context parallel, because of dataloader random seed, seems behavior changed in torch 2.6.0

@ETOgaosion ETOgaosion changed the title Update vllm with megatron Update vllm 0.8.2 with megatron 0.11.0 Apr 13, 2025
@vermouth1992 vermouth1992 merged commit f976b18 into volcengine:main Apr 14, 2025
24 checks passed
yellowbee686 pushed a commit to yellowbee686/verl that referenced this pull request Apr 18, 2025
Parts of volcengine#851 

Including minimal of upgrade:

1. vllm 0.8.2 with megatron
2. part of per-tensor allgather and load weights
3. fix bugs with context parallel, because of dataloader random seed,
seems behavior changed in torch 2.6.0
yuchenwang3 pushed a commit to yuchenwang3/verl that referenced this pull request Apr 25, 2025
Parts of volcengine#851 

Including minimal of upgrade:

1. vllm 0.8.2 with megatron
2. part of per-tensor allgather and load weights
3. fix bugs with context parallel, because of dataloader random seed,
seems behavior changed in torch 2.6.0
yhyang201 pushed a commit to yhyang201/verl that referenced this pull request Apr 26, 2025
Parts of volcengine#851 

Including minimal of upgrade:

1. vllm 0.8.2 with megatron
2. part of per-tensor allgather and load weights
3. fix bugs with context parallel, because of dataloader random seed,
seems behavior changed in torch 2.6.0
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants