The prompt generation code is batching prompts into batches
The loop that sends those batches only seems to be using 1 prompt from each batch

It doesn't seem correct as most of the instructions in the batch aren't used

Each iteration for this loop takes a batch of prompts
https://github.com/instruct-lab/cli/blob/881b8fafbc8537d2be87f930900794bd0dde5789/cli/generator/utils.py#L95

But then only using one prompt from that batch
https://github.com/instruct-lab/cli/blob/881b8fafbc8537d2be87f930900794bd0dde5789/cli/generator/utils.py#L108