Skip to content

feat: grammar-aware constrained decoding #165

@Ki-Seki

Description

@Ki-Seki

Users may define highly complex CFGs. However, LLMs remain unaware of such grammars prior to decoding unless the grammar is included in their context. To ensure LLMs recognize these grammars, we must make the grammars visible within queries to LLMs.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions