Updated documentation for Grammar Backend #2545
Conversation
| @@ -223,6 +223,13 @@ | |||
| "## Structured decoding (JSON, Regex)\n", | |||
There was a problem hiding this comment.
You can define a JSON schema or regular expression to constrain the model's output, which depends on the grammar backend.
SGlang has two backends: outlines (default) and Xgrammar. Xgrammar enhances JSON decoding performance but does not support regular expressions. To use Xgrammar, add --grammar-backend xgrammar when launching the server:
There was a problem hiding this comment.
Updated and verified the functionality with Xgrammar backend.
|
This is just to update the current document, so a tiny modification is good enough. However, for the constraint decoding tutorial, please truly launch the server to check its correctness. Also, what's the status of the tutorial? @shuaills |
I'm working on it. Should it be in Jupyter Notebook format? And where should I put the tutorial? |
It should be a Notebook. Put it under |
Co-authored-by: Chayenne <zhaochen20@outlook.com>
Motivation
Improve documentation clarity around grammar backends.
#2505
Modifications
Updated documentation to clarify Xgrammar's JSON support and regex limitation.
Checklist