Skip to content

Change Review Process#3659

Open
Phlip79 wants to merge 3 commits intoNVIDIA:mainfrom
Phlip79:philip/change-review-process
Open

Change Review Process#3659
Phlip79 wants to merge 3 commits intoNVIDIA:mainfrom
Phlip79:philip/change-review-process

Conversation

@Phlip79
Copy link
Member

@Phlip79 Phlip79 commented Mar 2, 2026

What does this PR do ?

Changing the review process to:

  • force all new PRs be drafts
  • no longer using "Expert Review" label
  • PRs that have all necessary approvals have label "Approved" automatically added
  • automated the review process steps
  • updated all documentation to reflect this new process

Before this PR is merged in I will change all open PRs that do not have the "Expert Review" or "Final Review" process to draft PRs.

Contribution process

flowchart LR
    A[Pre-checks] --> B[PR Tests]
    subgraph Code Review/Approval
        C1[Expert Review] --> C2[Final Review]
    end
    B --> C1
    C2 --> D[Merge]
Loading

Pre-checks

  • I want this PR in a versioned release and have added the appropriate Milestone (e.g., Core 0.8)
  • I have added relevant unit tests
  • I have added relevant functional tests
  • I have added proper typing to my code Typing guidelines
  • I have added relevant documentation
  • I have run the autoformatter.sh on my PR

Code review

The following process is enforced via the CODEOWNERS file for changes into megatron/core. For changes outside of megatron/core, it is up to the PR author whether or not to tag the Final Reviewer team.

For MRs into `main` branch

Feel free to message or comment the @mcore-oncall to help accelerate your merge into main. The less complex your PR is, the faster it will be approved and merged!

(Step 1): Add PR label Expert Review

(Step 2): Collect the expert reviewers reviews

  1. Attach the Expert Review label when your PR is ready for review.
  2. GitHub auto-assigns expert reviewers based on your changes. They will get notified and pick up your PR soon.

⚠️ Only proceed to the next step once all reviewers have approved, merge-conflict are resolved and the CI is passing.
Final Review might get declined if these requirements are not fulfilled.

(Step 3): Final Review

  1. Add Final Review label
  2. GitHub auto-assigns final reviewers based on your changes. They will get notified and pick up your PR soon.

(Optional Step 4): Cherry-pick into release branch

If this PR also needs to be merged into core_r* release branches, after this PR has been merged, select Cherry-pick to open a new PR into the release branch.

For MRs into `dev` branch The proposed review process for `dev` branch is under active discussion.

MRs are mergable after one approval by either eharper@nvidia.com or zijiey@nvidia.com.

Merging your PR

Any member of core-adlr and core-nemo will be able to merge your PR.

@Phlip79 Phlip79 requested a review from a team as a code owner March 2, 2026 23:56
@copy-pr-bot
Copy link

copy-pr-bot bot commented Mar 2, 2026

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

@svcnvidia-nemo-ci svcnvidia-nemo-ci requested a review from a team March 2, 2026 23:56
@Phlip79 Phlip79 requested a review from ericharper March 2, 2026 23:59

on:
pull_request_target:
types: [opened]

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hi @Phlip79, I noticed this is only triggered on opened. Does the team want to include reopened as well? If a PR is closed and then reopened, it would currently bypass the 'force-to-draft' logic and stay in 'Ready for review' mode.

- Comment “/ok to test commid_id” to kick off testing suite
- Add the “Expert Review” label
- Select an expert reviewer from each expert group as a reviewer. If you’re unsure who to select, pick a “maintainer” or manager.
- Expert reviewers are auto-assigned when the PR is marked “Ready for Review”
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Strictly speaking, they will be notified after ready for review. Reviewers are attached as soon as the PR is being opened irrespective of draft mode. But I’ll leave finding the right level of technical depth to you

- **Expert reviewers should review within 1 business day.** Message the assigned reviewer if it is taking longer. The reviewer either needs to review the PR or suggest an alternate reviewer.
- If the reviewer is not responding after 2 business days, escalate to the reviewer's manager.
- Add the “Final Review” label after experts approve
- If the reviewer is not responding after 2 business days, escalate to the reviewers manager.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Who is this note for? Maybe it’s obsolete nowadays?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I.e. how do we do that if we cannot reach out to everyone? Maybe via MCore-oncall?

@Phlip79
Copy link
Member Author

Phlip79 commented Mar 3, 2026

/claude review

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants