-
Notifications
You must be signed in to change notification settings - Fork 5
feat(security): add agent fail-closed POC smoke suite #63
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
💡 Codex Review
Here are some automated review suggestions for this pull request.
Reviewed commit: b781d9a513
ℹ️ About Codex in GitHub
Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you
- Open a pull request for review
- Mark a draft as ready
- Comment "@codex review".
If Codex has suggestions, it will comment; otherwise it will react with 👍.
Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".
|
Added follow-up security testing changes in commit
Validation run:
|
|
Addressed all currently unresolved PR #63 review threads in Changes made
Validation
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Cursor Bugbot has reviewed your changes and found 1 potential issue.
Bugbot Autofix is OFF. To automatically fix reported issues with Cloud Agents, enable Autofix in the Cursor dashboard.
|
Codex Review: Didn't find any major issues. Can't wait for the next one! ℹ️ About Codex in GitHubYour team has set up Codex to review pull requests in this repo. Reviews are triggered when you
If Codex has suggestions, it will comment; otherwise it will react with 👍. Codex can also answer questions or update the PR. Try commenting "@codex address that feedback". |
|
Addressed in
This restores the intended behavior where the policy torture PR gate blocks the |
Summary
agent-fail-closed-smoke) that runs all POCs and uploads a consolidated report artifactdocs/reports/agent-fail-closed-pocs.mdValidation
npm --prefix packages/adapters/clawdstrike-adapter-core ci && npm --prefix packages/adapters/clawdstrike-adapter-core run buildnpm --prefix packages/adapters/clawdstrike-codex ci && npm --prefix packages/adapters/clawdstrike-codex run build && npm --prefix packages/adapters/clawdstrike-codex testnpm --prefix packages/adapters/clawdstrike-claude-code ci && npm --prefix packages/adapters/clawdstrike-claude-code run build && npm --prefix packages/adapters/clawdstrike-claude-code testnpm --prefix packages/adapters/clawdstrike-hush-cli-engine ci && npm --prefix packages/adapters/clawdstrike-hush-cli-engine run build && npm --prefix packages/adapters/clawdstrike-hush-cli-engine testnpm --prefix packages/adapters/clawdstrike-hushd-engine ci && npm --prefix packages/adapters/clawdstrike-hushd-engine run build && npm --prefix packages/adapters/clawdstrike-hushd-engine testnode tools/scripts/agent-fail-closed-smoke.mjsNote
Medium Risk
Adds new CI gating suites and new fail-closed regression coverage across adapters and policy evaluation; risk is mainly CI flakiness/runtime increases and potential false negatives/positives in security checks.
Overview
Expands CI security gating by adding a
policy-torturejob that runs a new battery of policy stress suites (merge semantics, posture transitions, guard coverage, extends loop/depth failures) and uploads stable JSON reports;checknow depends on this new gate.Adds deterministic fail-closed verification for agent adapters: new per-adapter POC scripts (
poc:fail-closed) plus a consolidatedagent-fail-closed-smokeCI job that runs all POCs, generatesdocs/reports/agent-fail-closed-smoke.{json,md}, and uploads them as artifacts.Tightens regression coverage in code/tests by adding Rust IRM test coverage for path extraction precedence (
filesystem_irm_prefers_object_path_over_pathlike_string_arg) and new adapter unit tests ensuring blocked tool calls never execute dispatcher side effects, plus engine tests that deny withengine_erroron spawn/network failures.Written by Cursor Bugbot for commit f1cb98b. This will update automatically on new commits. Configure here.