-
Notifications
You must be signed in to change notification settings - Fork 2.8k
Closed
Labels
Description
Hello. In our use case, we would like to make calls to the backend with a "grammar" or "cfg" field similar to what outline implements in their vllm implementation:
Would this be in the cards? I see there is already a Lark CFG implementation, but it seems to be front end/python only.
tranhoangnguyen03 and themrzmaster