doc: emphasize and notify the usage of chat_template #3589

mickqian · 2025-02-15T07:13:39Z

Motivation

As mentioned by @yizhang2077 , chat-template is even more important in VLM, as image embedding involves many special tokens.

checked the chat_template actually in use with official chat_template. if not matched, a warning is given.
update docs

Format your code according to the Code Formatting with Pre-Commit.
Add unit tests as outlined in the Running Unit Tests.
Update documentation / docstrings / example tutorials as needed, according to Writing Documentation.
Provide throughput / latency benchmark results and accuracy evaluation results as needed, according to Benchmark and Profiling and Accuracy Results.
For reviewers: If you haven't made any contributions to this PR and are only assisting with merging the main branch, please remove yourself as a co-author when merging the PR.
Please feel free to join our Slack channel at https://slack.sglang.ai to discuss your PR.

zhaochenyang20

LGTM

doc: emphasize the usage of chat_template

8c8db05

mickqian requested review from merrymercy, Ying1123, hnyls2002, zhyncs, ispobock and ByronHsu as code owners February 15, 2025 07:13

mickqian force-pushed the doc_chat_template branch 3 times, most recently from bc9a141 to 945429f Compare February 15, 2025 07:22

doc: emphasize and notify the usage of chat_template

a1f41a9

mickqian force-pushed the doc_chat_template branch from 945429f to a1f41a9 Compare February 15, 2025 07:22

zhaochenyang20 added 2 commits February 14, 2025 23:36

Update server_arguments.md

d1a93be

Update adapter.py

766ffa9

zhaochenyang20 approved these changes Feb 15, 2025

View reviewed changes

Merge branch 'main' into doc_chat_template

c5d65df

zhaochenyang20 merged commit 7711ac6 into sgl-project:main Feb 15, 2025
16 of 19 checks passed