Streaming each weight tensor (gather each weight) #163
Description
Gather each dtensor weight one at a time and send it to vllm; repeatedly call the weight update on vllm side
Metadata
Metadata
Assignees
Labels
No labels
{{ message }}
Gather each dtensor weight one at a time and send it to vllm; repeatedly call the weight update on vllm side