Skip to content

Add workflow to prevent new Groovy test files#10730

Merged
gh-worker-dd-mergequeue-cf854d[bot] merged 5 commits intomasterfrom
sarahchen6/workflow-to-enforce-no-groovy
Mar 4, 2026
Merged

Add workflow to prevent new Groovy test files#10730
gh-worker-dd-mergequeue-cf854d[bot] merged 5 commits intomasterfrom
sarahchen6/workflow-to-enforce-no-groovy

Conversation

@sarahchen6
Copy link
Contributor

What Does This Do

Add a new Github Action workflow that prevents new Groovy test files from creation. Specifically, this workflow:

  • Fails and adds a PR comment if a new Groovy test file was created in a module that is listed in .github/migrated-modules.txt. The expectation is that all fully-migrated modules are listed in .github/migrated-modules.txt.
  • Passes and adds a warning PR comment if a new Groovy test file was added in a module that has not been fully migrated. dd-smoke-tests and dd-java-agent/instrumentations are excluded from this.
  • Can be skipped by adding the override-groovy-enforcement label to this PR.

Motivation

During our broader effort to migrate Groovy test files to Java, we should not introduce further regressions. Since dd-smoke-tests and dd-java-agent/instrumentations are latter priorities, we excluded them from these checks for now.

Additional Notes

The workflow needs to be merged to master before testing.

Contributor Checklist

Jira ticket: [PROJ-IDENT]

Note: Once your PR is ready to merge, add it to the merge queue by commenting /merge. /merge -c cancels the queue request. /merge -f --reason "reason" skips all merge queue checks; please use this judiciously, as some checks do not run at the PR-level. For more information, see this doc.

@sarahchen6 sarahchen6 force-pushed the sarahchen6/workflow-to-enforce-no-groovy branch from b77de38 to 8164b95 Compare March 3, 2026 20:43
@sarahchen6 sarahchen6 added tag: no release notes Changes to exclude from release notes comp: tooling Build & Tooling labels Mar 3, 2026
@sarahchen6 sarahchen6 marked this pull request as ready for review March 3, 2026 21:09
@sarahchen6 sarahchen6 requested a review from a team as a code owner March 3, 2026 21:09
@sarahchen6 sarahchen6 requested review from PerfectSlayer and removed request for a team March 3, 2026 21:09
@sarahchen6 sarahchen6 added tag: override-groovy-enforcement Override the "Enforce Groovy Migration" check and removed tag: override-groovy-enforcement Override the "Enforce Groovy Migration" check labels Mar 3, 2026
@sarahchen6
Copy link
Contributor Author

sarahchen6 commented Mar 3, 2026

We can confirm that adding the override-groovy-enforcement label skips the check; however, the rest of the workflow depends on .github/migrated-modules.txt being on master.

@sarahchen6 sarahchen6 added the tag: override-groovy-enforcement Override the "Enforce Groovy Migration" check label Mar 3, 2026
@pr-commenter
Copy link

pr-commenter bot commented Mar 3, 2026

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/workflow-to-enforce-no-groovy
git_commit_date 1772654042 1772654233
git_commit_sha 2f04ccb 70c34b6
release_version 1.61.0-SNAPSHOT~2f04ccb83f 1.61.0-SNAPSHOT~70c34b64bb
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1772656023 1772656023
ci_job_id 1476664069 1476664069
ci_pipeline_id 100433965 100433965
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-3-wcjmw5td 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-3-wcjmw5td 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 66 metrics, 5 unstable metrics.

Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.61.0-SNAPSHOT~70c34b64bb, baseline=1.61.0-SNAPSHOT~2f04ccb83f

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.055 s) : 0, 1055121
Total [baseline] (8.836 s) : 0, 8835813
Agent [candidate] (1.058 s) : 0, 1058380
Total [candidate] (8.807 s) : 0, 8806730
section iast
Agent [baseline] (1.224 s) : 0, 1223539
Total [baseline] (9.551 s) : 0, 9551443
Agent [candidate] (1.235 s) : 0, 1234627
Total [candidate] (9.55 s) : 0, 9549582
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.055 s -
Agent iast 1.224 s 168.419 ms (16.0%)
Total tracing 8.836 s -
Total iast 9.551 s 715.63 ms (8.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.058 s -
Agent iast 1.235 s 176.247 ms (16.7%)
Total tracing 8.807 s -
Total iast 9.55 s 742.852 ms (8.4%)
gantt
    title insecure-bank - break down per module: candidate=1.61.0-SNAPSHOT~70c34b64bb, baseline=1.61.0-SNAPSHOT~2f04ccb83f

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.209 ms) : 0, 1209
crashtracking [candidate] (1.191 ms) : 0, 1191
BytebuddyAgent [baseline] (628.056 ms) : 0, 628056
BytebuddyAgent [candidate] (628.74 ms) : 0, 628740
AgentMeter [baseline] (28.975 ms) : 0, 28975
AgentMeter [candidate] (29.157 ms) : 0, 29157
GlobalTracer [baseline] (256.144 ms) : 0, 256144
GlobalTracer [candidate] (256.762 ms) : 0, 256762
AppSec [baseline] (31.476 ms) : 0, 31476
AppSec [candidate] (31.453 ms) : 0, 31453
Debugger [baseline] (58.353 ms) : 0, 58353
Debugger [candidate] (58.589 ms) : 0, 58589
Remote Config [baseline] (585.22 µs) : 0, 585
Remote Config [candidate] (585.349 µs) : 0, 585
Telemetry [baseline] (8.589 ms) : 0, 8589
Telemetry [candidate] (8.711 ms) : 0, 8711
Flare Poller [baseline] (5.689 ms) : 0, 5689
Flare Poller [candidate] (7.208 ms) : 0, 7208
section iast
crashtracking [baseline] (1.195 ms) : 0, 1195
crashtracking [candidate] (1.196 ms) : 0, 1196
BytebuddyAgent [baseline] (794.879 ms) : 0, 794879
BytebuddyAgent [candidate] (802.637 ms) : 0, 802637
AgentMeter [baseline] (11.269 ms) : 0, 11269
AgentMeter [candidate] (11.594 ms) : 0, 11594
GlobalTracer [baseline] (246.163 ms) : 0, 246163
GlobalTracer [candidate] (248.345 ms) : 0, 248345
AppSec [baseline] (26.22 ms) : 0, 26220
AppSec [candidate] (27.323 ms) : 0, 27323
Debugger [baseline] (62.386 ms) : 0, 62386
Debugger [candidate] (61.744 ms) : 0, 61744
Remote Config [baseline] (528.508 µs) : 0, 529
Remote Config [candidate] (526.354 µs) : 0, 526
Telemetry [baseline] (14.837 ms) : 0, 14837
Telemetry [candidate] (14.832 ms) : 0, 14832
Flare Poller [baseline] (4.952 ms) : 0, 4952
Flare Poller [candidate] (4.886 ms) : 0, 4886
IAST [baseline] (25.091 ms) : 0, 25091
IAST [candidate] (25.361 ms) : 0, 25361
Loading
Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.61.0-SNAPSHOT~70c34b64bb, baseline=1.61.0-SNAPSHOT~2f04ccb83f

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.056 s) : 0, 1055543
Total [baseline] (10.948 s) : 0, 10947951
Agent [candidate] (1.056 s) : 0, 1056496
Total [candidate] (10.983 s) : 0, 10982915
section appsec
Agent [baseline] (1.244 s) : 0, 1243620
Total [baseline] (11.101 s) : 0, 11101438
Agent [candidate] (1.242 s) : 0, 1241663
Total [candidate] (11.206 s) : 0, 11205537
section iast
Agent [baseline] (1.226 s) : 0, 1226270
Total [baseline] (11.3 s) : 0, 11299735
Agent [candidate] (1.225 s) : 0, 1225249
Total [candidate] (11.359 s) : 0, 11358959
section profiling
Agent [baseline] (1.195 s) : 0, 1195260
Total [baseline] (11.139 s) : 0, 11138908
Agent [candidate] (1.181 s) : 0, 1180802
Total [candidate] (10.908 s) : 0, 10907552
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.056 s -
Agent appsec 1.244 s 188.077 ms (17.8%)
Agent iast 1.226 s 170.728 ms (16.2%)
Agent profiling 1.195 s 139.717 ms (13.2%)
Total tracing 10.948 s -
Total appsec 11.101 s 153.487 ms (1.4%)
Total iast 11.3 s 351.784 ms (3.2%)
Total profiling 11.139 s 190.957 ms (1.7%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.056 s -
Agent appsec 1.242 s 185.167 ms (17.5%)
Agent iast 1.225 s 168.753 ms (16.0%)
Agent profiling 1.181 s 124.306 ms (11.8%)
Total tracing 10.983 s -
Total appsec 11.206 s 222.622 ms (2.0%)
Total iast 11.359 s 376.044 ms (3.4%)
Total profiling 10.908 s -75.363 ms (-0.7%)
gantt
    title petclinic - break down per module: candidate=1.61.0-SNAPSHOT~70c34b64bb, baseline=1.61.0-SNAPSHOT~2f04ccb83f

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.192 ms) : 0, 1192
crashtracking [candidate] (1.192 ms) : 0, 1192
BytebuddyAgent [baseline] (626.583 ms) : 0, 626583
BytebuddyAgent [candidate] (627.134 ms) : 0, 627134
AgentMeter [baseline] (29.012 ms) : 0, 29012
AgentMeter [candidate] (29.064 ms) : 0, 29064
GlobalTracer [baseline] (255.851 ms) : 0, 255851
GlobalTracer [candidate] (255.527 ms) : 0, 255527
AppSec [baseline] (31.366 ms) : 0, 31366
AppSec [candidate] (31.301 ms) : 0, 31301
Debugger [baseline] (59.087 ms) : 0, 59087
Debugger [candidate] (59.046 ms) : 0, 59046
Remote Config [baseline] (579.32 µs) : 0, 579
Remote Config [candidate] (595.103 µs) : 0, 595
Telemetry [baseline] (8.565 ms) : 0, 8565
Telemetry [candidate] (8.628 ms) : 0, 8628
Flare Poller [baseline] (7.312 ms) : 0, 7312
Flare Poller [candidate] (8.168 ms) : 0, 8168
section appsec
crashtracking [baseline] (1.2 ms) : 0, 1200
crashtracking [candidate] (1.181 ms) : 0, 1181
BytebuddyAgent [baseline] (657.232 ms) : 0, 657232
BytebuddyAgent [candidate] (656.213 ms) : 0, 656213
AgentMeter [baseline] (11.977 ms) : 0, 11977
AgentMeter [candidate] (11.914 ms) : 0, 11914
GlobalTracer [baseline] (257.778 ms) : 0, 257778
GlobalTracer [candidate] (257.018 ms) : 0, 257018
AppSec [baseline] (176.823 ms) : 0, 176823
AppSec [candidate] (176.937 ms) : 0, 176937
Debugger [baseline] (65.477 ms) : 0, 65477
Debugger [candidate] (65.237 ms) : 0, 65237
Remote Config [baseline] (564.864 µs) : 0, 565
Remote Config [candidate] (574.846 µs) : 0, 575
Telemetry [baseline] (8.925 ms) : 0, 8925
Telemetry [candidate] (9.05 ms) : 0, 9050
Flare Poller [baseline] (3.577 ms) : 0, 3577
Flare Poller [candidate] (3.568 ms) : 0, 3568
IAST [baseline] (23.864 ms) : 0, 23864
IAST [candidate] (23.89 ms) : 0, 23890
section iast
crashtracking [baseline] (1.194 ms) : 0, 1194
crashtracking [candidate] (1.185 ms) : 0, 1185
BytebuddyAgent [baseline] (795.722 ms) : 0, 795722
BytebuddyAgent [candidate] (794.549 ms) : 0, 794549
AgentMeter [baseline] (11.32 ms) : 0, 11320
AgentMeter [candidate] (11.284 ms) : 0, 11284
GlobalTracer [baseline] (247.007 ms) : 0, 247007
GlobalTracer [candidate] (247.095 ms) : 0, 247095
AppSec [baseline] (26.422 ms) : 0, 26422
AppSec [candidate] (26.271 ms) : 0, 26271
Debugger [baseline] (63.227 ms) : 0, 63227
Debugger [candidate] (63.419 ms) : 0, 63419
Remote Config [baseline] (528.141 µs) : 0, 528
Remote Config [candidate] (524.184 µs) : 0, 524
Telemetry [baseline] (14.826 ms) : 0, 14826
Telemetry [candidate] (14.876 ms) : 0, 14876
Flare Poller [baseline] (4.867 ms) : 0, 4867
Flare Poller [candidate] (5.027 ms) : 0, 5027
IAST [baseline] (25.189 ms) : 0, 25189
IAST [candidate] (25.111 ms) : 0, 25111
section profiling
crashtracking [baseline] (1.179 ms) : 0, 1179
crashtracking [candidate] (1.165 ms) : 0, 1165
BytebuddyAgent [baseline] (691.64 ms) : 0, 691640
BytebuddyAgent [candidate] (682.153 ms) : 0, 682153
AgentMeter [baseline] (8.675 ms) : 0, 8675
AgentMeter [candidate] (8.574 ms) : 0, 8574
GlobalTracer [baseline] (217.781 ms) : 0, 217781
GlobalTracer [candidate] (215.172 ms) : 0, 215172
AppSec [baseline] (32.289 ms) : 0, 32289
AppSec [candidate] (31.918 ms) : 0, 31918
Debugger [baseline] (65.03 ms) : 0, 65030
Debugger [candidate] (61.811 ms) : 0, 61811
Remote Config [baseline] (574.571 µs) : 0, 575
Remote Config [candidate] (576.725 µs) : 0, 577
Telemetry [baseline] (9.06 ms) : 0, 9060
Telemetry [candidate] (10.468 ms) : 0, 10468
Flare Poller [baseline] (3.492 ms) : 0, 3492
Flare Poller [candidate] (4.324 ms) : 0, 4324
ProfilingAgent [baseline] (94.095 ms) : 0, 94095
ProfilingAgent [candidate] (93.849 ms) : 0, 93849
Profiling [baseline] (94.664 ms) : 0, 94664
Profiling [candidate] (94.418 ms) : 0, 94418
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/workflow-to-enforce-no-groovy
git_commit_date 1772654042 1772654233
git_commit_sha 2f04ccb 70c34b6
release_version 1.61.0-SNAPSHOT~2f04ccb83f 1.61.0-SNAPSHOT~70c34b64bb
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1772656492 1772656492
ci_job_id 1476664071 1476664071
ci_pipeline_id 100433965 100433965
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-4-b0zdzy4b 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-4-b0zdzy4b 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 2 performance regressions! Performance is the same for 17 metrics, 15 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:petclinic:iast:high_load worse
[+0.976ms; +1.636ms] or [+5.655%; +9.476%]
worse
[+1.606ms; +2.948ms] or [+5.706%; +10.473%]
unstable
[-42.911op/s; +7.911op/s] or [-16.244%; +2.995%]
18.575ms 30.421ms 246.656op/s 17.269ms 28.144ms 264.156op/s
scenario:load:petclinic:no_agent:high_load better
[-2.383ms; -1.181ms] or [-12.776%; -6.334%]
better
[-3.576ms; -0.899ms] or [-11.526%; -2.899%]
unstable
[-1.607op/s; +51.857op/s] or [-0.660%; +21.297%]
16.871ms 28.788ms 268.625op/s 18.653ms 31.026ms 243.500op/s
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~70c34b64bb, baseline=1.61.0-SNAPSHOT~2f04ccb83f
    dateFormat X
    axisFormat %s
section baseline
no_agent (19.169 ms) : 18974, 19365
.   : milestone, 19169,
appsec (18.673 ms) : 18489, 18858
.   : milestone, 18673,
code_origins (17.467 ms) : 17296, 17639
.   : milestone, 17467,
iast (17.662 ms) : 17490, 17833
.   : milestone, 17662,
profiling (18.682 ms) : 18489, 18875
.   : milestone, 18682,
tracing (17.724 ms) : 17548, 17900
.   : milestone, 17724,
section candidate
no_agent (17.367 ms) : 17192, 17541
.   : milestone, 17367,
appsec (18.942 ms) : 18749, 19136
.   : milestone, 18942,
code_origins (17.641 ms) : 17468, 17815
.   : milestone, 17641,
iast (18.917 ms) : 18722, 19111
.   : milestone, 18917,
profiling (19.148 ms) : 18958, 19339
.   : milestone, 19148,
tracing (17.905 ms) : 17728, 18082
.   : milestone, 17905,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.169 ms [18.974 ms, 19.365 ms] -
appsec 18.673 ms [18.489 ms, 18.858 ms] -496.039 µs (-2.6%)
code_origins 17.467 ms [17.296 ms, 17.639 ms] -1.702 ms (-8.9%)
iast 17.662 ms [17.49 ms, 17.833 ms] -1.508 ms (-7.9%)
profiling 18.682 ms [18.489 ms, 18.875 ms] -487.288 µs (-2.5%)
tracing 17.724 ms [17.548 ms, 17.9 ms] -1.446 ms (-7.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.367 ms [17.192 ms, 17.541 ms] -
appsec 18.942 ms [18.749 ms, 19.136 ms] 1.576 ms (9.1%)
code_origins 17.641 ms [17.468 ms, 17.815 ms] 274.831 µs (1.6%)
iast 18.917 ms [18.722 ms, 19.111 ms] 1.55 ms (8.9%)
profiling 19.148 ms [18.958 ms, 19.339 ms] 1.782 ms (10.3%)
tracing 17.905 ms [17.728 ms, 18.082 ms] 538.305 µs (3.1%)
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~70c34b64bb, baseline=1.61.0-SNAPSHOT~2f04ccb83f
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.193 ms) : 1181, 1204
.   : milestone, 1193,
iast (3.242 ms) : 3193, 3290
.   : milestone, 3242,
iast_FULL (5.759 ms) : 5701, 5816
.   : milestone, 5759,
iast_GLOBAL (3.429 ms) : 3377, 3481
.   : milestone, 3429,
profiling (2.116 ms) : 2097, 2134
.   : milestone, 2116,
tracing (1.806 ms) : 1791, 1821
.   : milestone, 1806,
section candidate
no_agent (1.197 ms) : 1185, 1209
.   : milestone, 1197,
iast (3.175 ms) : 3132, 3219
.   : milestone, 3175,
iast_FULL (5.9 ms) : 5841, 5959
.   : milestone, 5900,
iast_GLOBAL (3.526 ms) : 3476, 3577
.   : milestone, 3526,
profiling (2.027 ms) : 2010, 2044
.   : milestone, 2027,
tracing (1.793 ms) : 1778, 1809
.   : milestone, 1793,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.193 ms [1.181 ms, 1.204 ms] -
iast 3.242 ms [3.193 ms, 3.29 ms] 2.049 ms (171.8%)
iast_FULL 5.759 ms [5.701 ms, 5.816 ms] 4.566 ms (382.9%)
iast_GLOBAL 3.429 ms [3.377 ms, 3.481 ms] 2.236 ms (187.5%)
profiling 2.116 ms [2.097 ms, 2.134 ms] 923.121 µs (77.4%)
tracing 1.806 ms [1.791 ms, 1.821 ms] 613.45 µs (51.4%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.197 ms [1.185 ms, 1.209 ms] -
iast 3.175 ms [3.132 ms, 3.219 ms] 1.979 ms (165.3%)
iast_FULL 5.9 ms [5.841 ms, 5.959 ms] 4.703 ms (393.0%)
iast_GLOBAL 3.526 ms [3.476 ms, 3.577 ms] 2.33 ms (194.7%)
profiling 2.027 ms [2.01 ms, 2.044 ms] 830.65 µs (69.4%)
tracing 1.793 ms [1.778 ms, 1.809 ms] 596.541 µs (49.8%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/workflow-to-enforce-no-groovy
git_commit_date 1772654042 1772654233
git_commit_sha 2f04ccb 70c34b6
release_version 1.61.0-SNAPSHOT~2f04ccb83f 1.61.0-SNAPSHOT~70c34b64bb
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1772656132 1772656132
ci_job_id 1476664072 1476664072
ci_pipeline_id 100433965 100433965
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-pqhjl3ma 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-pqhjl3ma 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 0 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:dacapo:tomcat:appsec better
[-1.470ms; -1.122ms] or [-38.701%; -29.542%]
2.501ms 3.797ms
Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~70c34b64bb, baseline=1.61.0-SNAPSHOT~2f04ccb83f
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.01 s) : 15010000, 15010000
.   : milestone, 15010000,
appsec (15.067 s) : 15067000, 15067000
.   : milestone, 15067000,
iast (18.243 s) : 18243000, 18243000
.   : milestone, 18243000,
iast_GLOBAL (17.712 s) : 17712000, 17712000
.   : milestone, 17712000,
profiling (14.85 s) : 14850000, 14850000
.   : milestone, 14850000,
tracing (15.164 s) : 15164000, 15164000
.   : milestone, 15164000,
section candidate
no_agent (15.005 s) : 15005000, 15005000
.   : milestone, 15005000,
appsec (14.887 s) : 14887000, 14887000
.   : milestone, 14887000,
iast (18.342 s) : 18342000, 18342000
.   : milestone, 18342000,
iast_GLOBAL (17.78 s) : 17780000, 17780000
.   : milestone, 17780000,
profiling (14.977 s) : 14977000, 14977000
.   : milestone, 14977000,
tracing (15.168 s) : 15168000, 15168000
.   : milestone, 15168000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.01 s [15.01 s, 15.01 s] -
appsec 15.067 s [15.067 s, 15.067 s] 57.0 ms (0.4%)
iast 18.243 s [18.243 s, 18.243 s] 3.233 s (21.5%)
iast_GLOBAL 17.712 s [17.712 s, 17.712 s] 2.702 s (18.0%)
profiling 14.85 s [14.85 s, 14.85 s] -160.0 ms (-1.1%)
tracing 15.164 s [15.164 s, 15.164 s] 154.0 ms (1.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.005 s [15.005 s, 15.005 s] -
appsec 14.887 s [14.887 s, 14.887 s] -118.0 ms (-0.8%)
iast 18.342 s [18.342 s, 18.342 s] 3.337 s (22.2%)
iast_GLOBAL 17.78 s [17.78 s, 17.78 s] 2.775 s (18.5%)
profiling 14.977 s [14.977 s, 14.977 s] -28.0 ms (-0.2%)
tracing 15.168 s [15.168 s, 15.168 s] 163.0 ms (1.1%)
Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~70c34b64bb, baseline=1.61.0-SNAPSHOT~2f04ccb83f
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.468 ms) : 1456, 1479
.   : milestone, 1468,
appsec (3.797 ms) : 3575, 4019
.   : milestone, 3797,
iast (2.236 ms) : 2168, 2304
.   : milestone, 2236,
iast_GLOBAL (2.285 ms) : 2216, 2355
.   : milestone, 2285,
profiling (2.066 ms) : 2012, 2120
.   : milestone, 2066,
tracing (2.046 ms) : 1993, 2099
.   : milestone, 2046,
section candidate
no_agent (1.471 ms) : 1460, 1483
.   : milestone, 1471,
appsec (2.501 ms) : 2447, 2556
.   : milestone, 2501,
iast (2.237 ms) : 2169, 2305
.   : milestone, 2237,
iast_GLOBAL (2.288 ms) : 2219, 2357
.   : milestone, 2288,
profiling (2.099 ms) : 2043, 2155
.   : milestone, 2099,
tracing (2.045 ms) : 1993, 2098
.   : milestone, 2045,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.468 ms [1.456 ms, 1.479 ms] -
appsec 3.797 ms [3.575 ms, 4.019 ms] 2.329 ms (158.7%)
iast 2.236 ms [2.168 ms, 2.304 ms] 768.48 µs (52.4%)
iast_GLOBAL 2.285 ms [2.216 ms, 2.355 ms] 817.903 µs (55.7%)
profiling 2.066 ms [2.012 ms, 2.12 ms] 598.117 µs (40.8%)
tracing 2.046 ms [1.993 ms, 2.099 ms] 578.426 µs (39.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.471 ms [1.46 ms, 1.483 ms] -
appsec 2.501 ms [2.447 ms, 2.556 ms] 1.03 ms (70.0%)
iast 2.237 ms [2.169 ms, 2.305 ms] 765.776 µs (52.1%)
iast_GLOBAL 2.288 ms [2.219 ms, 2.357 ms] 816.481 µs (55.5%)
profiling 2.099 ms [2.043 ms, 2.155 ms] 628.217 µs (42.7%)
tracing 2.045 ms [1.993 ms, 2.098 ms] 574.223 µs (39.0%)

Copy link
Contributor

@PerfectSlayer PerfectSlayer left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👏 praise: ‏Thanks for taking care of it!
I left few comments, especially around the migrated-modules.txt on master.

❔ question: ‏I saw there was 2 comments, one for warnings, one for regressions.
I wonder if it would not be easier to have a single one? You can generate its content (both warnings and regression) and:

  • add/update the unique comment if there is one or the other + fail the check
  • delete the unique comment if present otherwise

How does it sound?

🎯 suggestion: Additionally, you can update the skill to ask to update the migrated-modules.txt file once module migration is complete.

@PerfectSlayer
Copy link
Contributor

@codex review

@PerfectSlayer
Copy link
Contributor

PerfectSlayer commented Mar 4, 2026

I asked additional review from Codex as I'm not well versed in reviewing Node JS code from Yaml files 😅

Copy link

@chatgpt-codex-connector chatgpt-codex-connector bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 8164b95343

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

@sarahchen6
Copy link
Contributor Author

❔ question: ‏I saw there was 2 comments, one for warnings, one for regressions.
I wonder if it would not be easier to have a single one?

It makes more sense IMO to separate the logic of the comments -- in particular, the regressions comment fails the workflow and needs to be addressed / deleted, whereas the warnings comment is just a recommendation. With separation, each comment can be individually updated instead of having to check the combined content.

This may make the PR initially more cluttered with two comments, but at least one of them will be deleted eventually. 🤔

@sarahchen6 sarahchen6 requested a review from a team as a code owner March 4, 2026 16:33
@sarahchen6 sarahchen6 requested a review from PerfectSlayer March 4, 2026 16:33
@sarahchen6 sarahchen6 added tag: override-groovy-enforcement Override the "Enforce Groovy Migration" check and removed tag: override-groovy-enforcement Override the "Enforce Groovy Migration" check labels Mar 4, 2026
Copy link
Contributor

@PerfectSlayer PerfectSlayer left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looking good!  Thanks for the follow up changes

This may make the PR initially more cluttered with two comments, but at least one of them will be deleted eventually. 🤔

Alright, let’s keep it that way then!

@sarahchen6
Copy link
Contributor Author

/merge

@gh-worker-devflow-routing-ef8351
Copy link

gh-worker-devflow-routing-ef8351 bot commented Mar 4, 2026

View all feedbacks in Devflow UI.

2026-03-04 22:24:58 UTC ℹ️ Start processing command /merge


2026-03-04 22:25:02 UTC ℹ️ MergeQueue: pull request added to the queue

The expected merge time in master is approximately 1h (p90).


2026-03-04 23:30:32 UTC ℹ️ MergeQueue: This merge request was merged

@gh-worker-dd-mergequeue-cf854d gh-worker-dd-mergequeue-cf854d bot merged commit 1108a4f into master Mar 4, 2026
740 of 742 checks passed
@gh-worker-dd-mergequeue-cf854d gh-worker-dd-mergequeue-cf854d bot deleted the sarahchen6/workflow-to-enforce-no-groovy branch March 4, 2026 23:30
@github-actions github-actions bot added this to the 1.61.0 milestone Mar 4, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

comp: tooling Build & Tooling tag: no release notes Changes to exclude from release notes tag: override-groovy-enforcement Override the "Enforce Groovy Migration" check

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants