Skip to content

Add --report CLI option#300

Open
mohit-sheth wants to merge 1 commit intocloud-bulldozer:mainfrom
mohit-sheth:summary-analysis
Open

Add --report CLI option#300
mohit-sheth wants to merge 1 commit intocloud-bulldozer:mainfrom
mohit-sheth:summary-analysis

Conversation

@mohit-sheth
Copy link
Collaborator

@mohit-sheth mohit-sheth commented Mar 2, 2026

Type of change

  • Refactor
  • New feature
  • Bug fix
  • Optimization
  • Documentation Update

Description

  • Adds a new --report CLI option that supports two modes:
    • Standalone mode (--report file1.json,file2.json): reads pre-existing orion JSON output files and generates a consolidated regression report without running any analysis
    • Integrated mode (--report as a flag): appends a summary report after normal orion analysis
    • Introduces orion/report.py module with functions to parse orion JSON output, extract changepoints with regressed metrics, and render a formatted report with per-workload pass/regression/skip status, metric tables, and PR relevance sorting

Prow PR: Add deferred Orion summary report step for consolidated regression reporting openshift/release#75575

@openshift-ci
Copy link

openshift-ci bot commented Mar 2, 2026

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by:
Once this PR has been reviewed and has the lgtm label, please assign mohit-sheth for approval. For more information see the Code Review Process.

The full list of commands accepted by this bot can be found here.

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

Signed-off-by: Mohit Sheth <msheth@redhat.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant