Skip to content

Improve CI investigation instructions to prevent agents from misreading workflow run status#12833

Merged
Simn merged 2 commits intodevelopmentfrom
copilot/fix-ci-log-issues
Mar 17, 2026
Merged

Improve CI investigation instructions to prevent agents from misreading workflow run status#12833
Simn merged 2 commits intodevelopmentfrom
copilot/fix-ci-log-issues

Conversation

Copy link
Contributor

Copilot AI commented Mar 17, 2026

Agents were confusing completed/failure workflow runs with in_progress ones, causing them to browse stale logs and get confused by already-fixed failures.

Changes

  • Anchor to the right run: instruct agents to first fetch the PR's head_sha via pull_request_read, then match it against list_workflow_runs results — avoiding accidental inspection of runs for older commits
  • Verify live status: require calling get_workflow_run before reporting status; never rely on a previously-seen value
  • Clarify status vs conclusion: explicitly document that status: "completed" + conclusion: "failure" is a done/failed run, not an in-progress one, and that conclusion must be checked separately from status
  • Reorder steps to reflect the correct investigation flow: get head SHA → find matching run → verify status → list failed jobs → fetch logs

📱 Kick off Copilot coding agent tasks wherever you are with GitHub Mobile, available on iOS and Android.

Co-authored-by: Simn <634365+Simn@users.noreply.github.com>
Copilot AI changed the title [WIP] Investigate CI log inconsistencies for agents Improve CI investigation instructions to prevent agents from misreading workflow run status Mar 17, 2026
Copilot AI requested a review from Simn March 17, 2026 11:39
Copilot finished work on behalf of Simn March 17, 2026 11:39
@Simn
Copy link
Member

Simn commented Mar 17, 2026

I feel like we shouldn't need to teach GitHub Copilot how GitHub Actions works, but perhaps the existing instructions indeed confused it.

@Simn Simn marked this pull request as ready for review March 17, 2026 11:41
@Simn Simn merged commit 04c500e into development Mar 17, 2026
37 checks passed
@Simn Simn deleted the copilot/fix-ci-log-issues branch March 17, 2026 11:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants