[OAI Server Refactor] [ChatCompletions & Completions] Remove batch requests, refine validation and streaming #7108
Description
Points: 1-2 days
Description: Remove the batch requests process, refine request validation logic and streaming generator structure.
Deliverables:
- Finish tasks listed below
- Add UTs if available
Metadata
Metadata
Assignees
Labels
No labels