Skip to content

[Feature] Support extra args for chat template #5635

@lkhl

Description

@lkhl

Checklist

Motivation

Thanks for your efforts in building such a powerful open source inference engine!

We recently found some inconveniences in using custom chat template. Could you please consider adding some features like chat_template_kwargs in vLLM? (please refer to this page)

Related resources

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions