-
Notifications
You must be signed in to change notification settings - Fork 4
Open
Description
Description
Currently, the LLM Module has input guardrails only for the RAG workflow. Since we are adding a pre-step before all workflows (tool classifier), it is better to relocate the input guardrail to execute before the tool classifier.
Current Flow
User Query → Tool Classifier → [Service | Context | RAG] → Input Guardrails (RAG only)
Proposed Flow
User Query → Input Guardrails → Tool Classifier → [Service | Context | RAG]
Technical Requirements
8.1 Move Guardrail Execution
Current Location: Inside RAG workflow execution
New Location: Before tool classifier in main orchestration pipeline
Acceptance Criteria
- Move input guardrail check before tool classifier in orchestration service
- Remove duplicate input guardrail checks from individual workflows
- Verify all workflows now protected by early guardrail check
- Test input guardrail blocking at new location
- Update cost tracking (input guardrails now tracked before routing)
- Update specification document with new flow diagram
- Integration tests for input guardrail blocking
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
No labels
Type
Projects
Status
Todo