Skip to content

[Feature Request] CFG in Backend Calls #21

@brucethemoose

Description

@brucethemoose

Hello. In our use case, we would like to make calls to the backend with a "grammar" or "cfg" field similar to what outline implements in their vllm implementation:

dottxt-ai/outlines#517

Would this be in the cards? I see there is already a Lark CFG implementation, but it seems to be front end/python only.

Metadata

Metadata

Assignees

Labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions