Add workflow for CI feedback, Fixes AB#3542397#3017
Conversation
|
❌ Work item link check failed. Description does not contain AB#{ID}. Click here to Learn more. |
shahzaibj
added
the
No-Changelog
There was a problem hiding this comment.
Pull request overview
Adds a GitHub agentic workflow intended to automatically investigate CI failures on Copilot-created PRs and post actionable @copilot feedback, along with the compiled/locked workflow artifact.
Changes:
- Introduces a gh-aw workflow prompt (
.md) describing how to detect failing CI checks and what to comment on the PR. - Adds the generated gh-aw compiled workflow (
*.lock.yml) that runs the Copilot CLI with GitHub + ADO MCP access and safe-outputs commenting.
Reviewed changes
Copilot reviewed 2 out of 2 changed files in this pull request and generated 3 comments.
| File | Description |
|---|---|
| .github/workflows/copilot-ci-feedback.md | gh-aw source prompt + configuration for the CI feedback agent workflow. |
| .github/workflows/copilot-ci-feedback.lock.yml | Auto-generated compiled workflow implementing the agent execution pipeline and safe-outputs handling. |
github-actions
bot
changed the title
There was a problem hiding this comment.
Pull request overview
Adds an agentic workflow definition to automatically investigate CI failures on Copilot-authored PRs and post actionable @copilot feedback, along with the generated locked GitHub Actions workflow.
Changes:
- Added a gh-aw workflow definition (
.md) describing CI failure investigation and feedback formatting. - Added the compiled/locked GitHub Actions workflow (
.lock.yml) generated from the definition.
Reviewed changes
Copilot reviewed 2 out of 2 changed files in this pull request and generated 4 comments.
| File | Description |
|---|---|
.github/workflows/copilot-ci-feedback.md |
Defines the CI-failure investigation + commenting process and config (triggers, tools, MCP, safe outputs). |
.github/workflows/copilot-ci-feedback.lock.yml |
Auto-generated compiled workflow that executes the defined process in GitHub Actions. |
…s, fix changelog ref, consistent author
There was a problem hiding this comment.
Pull request overview
Adds a new gh-aw “Copilot CI Feedback” workflow definition to automatically investigate CI failures on Copilot-authored PRs and post actionable @copilot feedback comments, along with the compiled lock workflow used by GitHub Actions.
Changes:
- Added
.github/workflows/copilot-ci-feedback.mddefining the CI-failure investigation + commenting process and tool access rules. - Added the compiled
.github/workflows/copilot-ci-feedback.lock.ymlgenerated from the markdown workflow definition.
Reviewed changes
Copilot reviewed 2 out of 2 changed files in this pull request and generated 3 comments.
| File | Description |
|---|---|
| .github/workflows/copilot-ci-feedback.md | Defines the workflow behavior/prompt for investigating CI failures and formatting feedback to the Copilot coding agent. |
| .github/workflows/copilot-ci-feedback.lock.yml | Auto-generated compiled workflow implementing the gh-aw orchestration and tool sandboxing described in the .md file. |
… author verification
There was a problem hiding this comment.
Pull request overview
This PR adds a gh-aw “agentic workflow” definition and its compiled lock workflow to automatically investigate CI failures on Copilot-authored PRs and post actionable @copilot feedback comments.
Changes:
- Added
.github/workflows/copilot-ci-feedback.mddescribing the CI-failure investigation/commenting workflow and rules. - Added compiled
.github/workflows/copilot-ci-feedback.lock.ymlgenerated from the.mddefinition.
Reviewed changes
Copilot reviewed 2 out of 2 changed files in this pull request and generated 4 comments.
| File | Description |
|---|---|
| .github/workflows/copilot-ci-feedback.md | Defines the gh-aw workflow prompt, triggers, tool permissions, MCP servers, and the comment format/rules for CI feedback. |
| .github/workflows/copilot-ci-feedback.lock.yml | Auto-generated gh-aw compiled workflow that executes the Copilot CLI agent with the configured tool allowlists and safe-output comment posting. |
… injection safety, author pre-check step
There was a problem hiding this comment.
Pull request overview
Adds an agentic GitHub workflow (via gh-aw) that is intended to investigate CI failures on Copilot-authored PRs and post actionable @copilot feedback comments so the agent can self-correct.
Changes:
- Added a gh-aw workflow definition (
.md) describing CI-failure investigation steps, error categorization, and comment format. - Added the compiled gh-aw workflow (
.lock.yml) to execute the agentic run and safe-output comment posting.
Reviewed changes
Copilot reviewed 2 out of 2 changed files in this pull request and generated 4 comments.
| File | Description |
|---|---|
| .github/workflows/copilot-ci-feedback.md | Defines the Copilot CI feedback workflow prompt/instructions and workflow frontmatter (triggers, permissions, MCP server, verification step). |
| .github/workflows/copilot-ci-feedback.lock.yml | Auto-generated compiled workflow that runs the Copilot agent, MCP gateway, safe-outputs, and conclusion handling. |
… (copilot-swe-agent[bot] only)
There was a problem hiding this comment.
Pull request overview
Adds a gh-aw “agentic workflow” that triggers on failing check_suite runs (and manual workflow_dispatch) to investigate CI failures on Copilot-authored PRs and post actionable feedback back to the PR.
Changes:
- Added
.github/workflows/copilot-ci-feedback.mddefining the workflow’s frontmatter (triggers/permissions/MCP tools) and the agent prompt/instructions for investigating failures and commenting results. - Added the generated
.github/workflows/copilot-ci-feedback.lock.ymlcompiled from the.mdviagh aw compile.
Reviewed changes
Copilot reviewed 2 out of 2 changed files in this pull request and generated 2 comments.
| File | Description |
|---|---|
| .github/workflows/copilot-ci-feedback.md | Source workflow definition + prompt content for CI-failure investigation and feedback commenting. |
| .github/workflows/copilot-ci-feedback.lock.yml | Auto-generated compiled workflow executed by GitHub Actions (from the .md). |
| exit 1 | ||
| fi | ||
| echo "PR #$PR_NUMBER is by Copilot agent. Proceeding." | ||
| echo "pr_number=$PR_NUMBER" >> $GITHUB_OUTPUT |
| echo "No PR found. Exiting." | ||
| exit 1 | ||
| fi | ||
| AUTHOR=$(gh pr view "$PR_NUMBER" --json author --jq '.author.login' 2>/dev/null || echo "") | ||
| if [ "$AUTHOR" != "copilot-swe-agent[bot]" ]; then | ||
| echo "PR #$PR_NUMBER author is '$AUTHOR', not copilot-swe-agent[bot]. Exiting." | ||
| exit 1 | ||
| fi | ||
| echo "PR #$PR_NUMBER is by Copilot agent. Proceeding." | ||
| echo "pr_number=$PR_NUMBER" >> $GITHUB_OUTPUT |
Fixes AB#3542397
This pull request introduces a new workflow documentation file for Copilot CI feedback. The file describes a process for automatically investigating CI failures on pull requests created by the Copilot coding agent and posting actionable feedback as comments for the agent to self-correct. The workflow includes detailed instructions, error categorization, and important rules to ensure relevant and non-redundant feedback.
Key additions and improvements:
New CI Feedback Workflow Documentation
.github/workflows/copilot-ci-feedback.mdthat outlines a process for monitoring CI failures on Copilot agent PRs, including when to act, how to investigate errors, and how to format feedback comments.