You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
2. Please use English, otherwise it will be closed.
Motivation
Thanks for your efforts in building such a powerful open source inference engine!
We recently found some inconveniences in using custom chat template. Could you please consider adding some features like chat_template_kwargs in vLLM? (please refer to this page)