Skip to content

Function calling not working as expected when streaming #168

@akshaylb

Description

@akshaylb

Describe the bug
When using function calling along with streaming, function calls seem to be ignored as the model passes the function arguments in chunks.

To Reproduce
Steps to reproduce the behavior:

  1. Initialize an openai assistant with streaming set to true
  2. Bind a function to the assistant
  3. Pass a prompt to invoke the function

Expected behavior
Function call chunks should be collected and call once complete.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions