In colocate mode -> Prompts and completions are misaligned in logs #3492
Description
Reproduction
Run a small experiment w/ log completions enabled to reproduce
per_device_train_batch_size: 1
max_steps: 1
num_generations: 2
use_vllm: true
vllm_mode: colocate
vllm_tensor_parallel_size: 2
log_completions: true
System Info
Checklist
- I have checked that my issue isn't already filed (see open issues)
- I have included my system information
- Any code provided is minimal, complete, and reproducible (more on MREs)
- Any code provided is properly formatted in code blocks, (no screenshot, more on code blocks)
- Any traceback provided is complete