Spark Launcher instrumentation: Capture time app-related metrics by aboitreaud · Pull Request #10708 · DataDog/dd-trace-java

aboitreaud · 2026-03-01T21:29:48Z

Motivation

We recently added instrumentation for the spark launcher class, but without any spark metric. As we collect a lot of Spark metrics for Spark application spans, we'd like to get some for launchers too. Issue is that there is no point in collecting the same metrics for the launcher VM as the launcher is a thin wrapper around spark applications.

The goal of this PR is to enrich the spark.launcher.launch spans with with metrics that make sense in the context of a launcher.

Changes

Collect 3 new metrics to measure the spark launcher to app latency:

"spark.launcher.time_to_connected_ms"
"spark.launcher.time_to_submitted_ms"
"spark.launcher.time_to_running_ms"

Values are computed by storing the start time and measuring the lag between start time and events related to each metric.

Additional Notes

Contributor Checklist

Format the title according to the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any other useful labels
Avoid using close, fix, or any linking keywords when referencing an issue
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, migration, or deletion
Update public documentation with any new configuration flags or behaviors

Jira ticket: [PROJ-IDENT]

Note: Once your PR is ready to merge, add it to the merge queue by commenting /merge. /merge -c cancels the queue request. /merge -f --reason "reason" skips all merge queue checks; please use this judiciously, as some checks do not run at the PR-level. For more information, see this doc.

pr-commenter · 2026-03-01T22:15:22Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	adrien.boitreaud/spark-launcher-metrics
git_commit_date	1772556429	1772557787
git_commit_sha	`9b93366`	`891d0df`
release_version	1.61.0-SNAPSHOT~9b93366972	1.60.0-SNAPSHOT~891d0dfb55

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1772559590	1772559590
ci_job_id	1472015848	1472015848
ci_pipeline_id	100089343	100089343
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-17xiht9y 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-17xiht9y 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 64 metrics, 7 unstable metrics.

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.60.0-SNAPSHOT~891d0dfb55, baseline=1.61.0-SNAPSHOT~9b93366972

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.054 s) : 0, 1054260
Total [baseline] (8.864 s) : 0, 8863782
Agent [candidate] (1.069 s) : 0, 1069263
Total [candidate] (8.815 s) : 0, 8814642
section iast
Agent [baseline] (1.24 s) : 0, 1239816
Total [baseline] (9.57 s) : 0, 9569851
Agent [candidate] (1.226 s) : 0, 1225846
Total [candidate] (9.546 s) : 0, 9546212

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.054 s	-
Agent	iast	1.24 s	185.556 ms (17.6%)
Total	tracing	8.864 s	-
Total	iast	9.57 s	706.069 ms (8.0%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.069 s	-
Agent	iast	1.226 s	156.583 ms (14.6%)
Total	tracing	8.815 s	-
Total	iast	9.546 s	731.57 ms (8.3%)

gantt
    title insecure-bank - break down per module: candidate=1.60.0-SNAPSHOT~891d0dfb55, baseline=1.61.0-SNAPSHOT~9b93366972

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.195 ms) : 0, 1195
crashtracking [candidate] (1.21 ms) : 0, 1210
BytebuddyAgent [baseline] (626.988 ms) : 0, 626988
BytebuddyAgent [candidate] (637.028 ms) : 0, 637028
AgentMeter [baseline] (29.154 ms) : 0, 29154
AgentMeter [candidate] (29.645 ms) : 0, 29645
GlobalTracer [baseline] (256.807 ms) : 0, 256807
GlobalTracer [candidate] (259.234 ms) : 0, 259234
AppSec [baseline] (31.454 ms) : 0, 31454
AppSec [candidate] (31.928 ms) : 0, 31928
Debugger [baseline] (58.623 ms) : 0, 58623
Debugger [candidate] (59.535 ms) : 0, 59535
Remote Config [baseline] (599.977 µs) : 0, 600
Remote Config [candidate] (592.355 µs) : 0, 592
Telemetry [baseline] (8.66 ms) : 0, 8660
Telemetry [candidate] (8.831 ms) : 0, 8831
Flare Poller [baseline] (4.925 ms) : 0, 4925
Flare Poller [candidate] (5.07 ms) : 0, 5070
section iast
crashtracking [baseline] (1.206 ms) : 0, 1206
crashtracking [candidate] (1.188 ms) : 0, 1188
BytebuddyAgent [baseline] (807.995 ms) : 0, 807995
BytebuddyAgent [candidate] (796.44 ms) : 0, 796440
AgentMeter [baseline] (11.74 ms) : 0, 11740
AgentMeter [candidate] (11.342 ms) : 0, 11342
GlobalTracer [baseline] (248.119 ms) : 0, 248119
GlobalTracer [candidate] (246.926 ms) : 0, 246926
AppSec [baseline] (26.497 ms) : 0, 26497
AppSec [candidate] (26.346 ms) : 0, 26346
Debugger [baseline] (62.534 ms) : 0, 62534
Debugger [candidate] (62.21 ms) : 0, 62210
Remote Config [baseline] (524.273 µs) : 0, 524
Remote Config [candidate] (517.161 µs) : 0, 517
Telemetry [baseline] (14.769 ms) : 0, 14769
Telemetry [candidate] (14.782 ms) : 0, 14782
Flare Poller [baseline] (4.893 ms) : 0, 4893
Flare Poller [candidate] (4.892 ms) : 0, 4892
IAST [baseline] (25.375 ms) : 0, 25375
IAST [candidate] (25.17 ms) : 0, 25170

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.60.0-SNAPSHOT~891d0dfb55, baseline=1.61.0-SNAPSHOT~9b93366972

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.056 s) : 0, 1055642
Total [baseline] (10.981 s) : 0, 10981443
Agent [candidate] (1.057 s) : 0, 1056679
Total [candidate] (11.081 s) : 0, 11080653
section appsec
Agent [baseline] (1.253 s) : 0, 1253004
Total [baseline] (11.105 s) : 0, 11104904
Agent [candidate] (1.245 s) : 0, 1245403
Total [candidate] (11.168 s) : 0, 11168136
section iast
Agent [baseline] (1.229 s) : 0, 1229095
Total [baseline] (11.384 s) : 0, 11384404
Agent [candidate] (1.234 s) : 0, 1234431
Total [candidate] (11.286 s) : 0, 11285640
section profiling
Agent [baseline] (1.182 s) : 0, 1182449
Total [baseline] (10.977 s) : 0, 10977009
Agent [candidate] (1.19 s) : 0, 1190273
Total [candidate] (11.017 s) : 0, 11017149

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.056 s	-
Agent	appsec	1.253 s	197.362 ms (18.7%)
Agent	iast	1.229 s	173.452 ms (16.4%)
Agent	profiling	1.182 s	126.807 ms (12.0%)
Total	tracing	10.981 s	-
Total	appsec	11.105 s	123.461 ms (1.1%)
Total	iast	11.384 s	402.961 ms (3.7%)
Total	profiling	10.977 s	-4.435 ms (-0.0%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.057 s	-
Agent	appsec	1.245 s	188.724 ms (17.9%)
Agent	iast	1.234 s	177.751 ms (16.8%)
Agent	profiling	1.19 s	133.593 ms (12.6%)
Total	tracing	11.081 s	-
Total	appsec	11.168 s	87.483 ms (0.8%)
Total	iast	11.286 s	204.987 ms (1.8%)
Total	profiling	11.017 s	-63.504 ms (-0.6%)

gantt
    title petclinic - break down per module: candidate=1.60.0-SNAPSHOT~891d0dfb55, baseline=1.61.0-SNAPSHOT~9b93366972

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.182 ms) : 0, 1182
crashtracking [candidate] (1.189 ms) : 0, 1189
BytebuddyAgent [baseline] (626.455 ms) : 0, 626455
BytebuddyAgent [candidate] (627.294 ms) : 0, 627294
AgentMeter [baseline] (28.966 ms) : 0, 28966
AgentMeter [candidate] (29.267 ms) : 0, 29267
GlobalTracer [baseline] (256.008 ms) : 0, 256008
GlobalTracer [candidate] (257.333 ms) : 0, 257333
AppSec [baseline] (31.391 ms) : 0, 31391
AppSec [candidate] (31.753 ms) : 0, 31753
Debugger [baseline] (59.27 ms) : 0, 59270
Debugger [candidate] (59.713 ms) : 0, 59713
Remote Config [baseline] (591.794 µs) : 0, 592
Remote Config [candidate] (592.044 µs) : 0, 592
Telemetry [baseline] (8.647 ms) : 0, 8647
Telemetry [candidate] (8.661 ms) : 0, 8661
Flare Poller [baseline] (7.237 ms) : 0, 7237
Flare Poller [candidate] (4.997 ms) : 0, 4997
section appsec
crashtracking [baseline] (1.196 ms) : 0, 1196
crashtracking [candidate] (1.193 ms) : 0, 1193
BytebuddyAgent [baseline] (662.836 ms) : 0, 662836
BytebuddyAgent [candidate] (657.839 ms) : 0, 657839
AgentMeter [baseline] (12.007 ms) : 0, 12007
AgentMeter [candidate] (11.993 ms) : 0, 11993
GlobalTracer [baseline] (259.509 ms) : 0, 259509
GlobalTracer [candidate] (258.123 ms) : 0, 258123
IAST [baseline] (24.215 ms) : 0, 24215
IAST [candidate] (23.904 ms) : 0, 23904
AppSec [baseline] (178.158 ms) : 0, 178158
AppSec [candidate] (177.104 ms) : 0, 177104
Debugger [baseline] (65.624 ms) : 0, 65624
Debugger [candidate] (65.722 ms) : 0, 65722
Remote Config [baseline] (562.351 µs) : 0, 562
Remote Config [candidate] (580.892 µs) : 0, 581
Telemetry [baseline] (9.035 ms) : 0, 9035
Telemetry [candidate] (9.125 ms) : 0, 9125
Flare Poller [baseline] (3.586 ms) : 0, 3586
Flare Poller [candidate] (3.621 ms) : 0, 3621
section iast
crashtracking [baseline] (1.185 ms) : 0, 1185
crashtracking [candidate] (1.191 ms) : 0, 1191
BytebuddyAgent [baseline] (796.672 ms) : 0, 796672
BytebuddyAgent [candidate] (801.098 ms) : 0, 801098
AgentMeter [baseline] (11.37 ms) : 0, 11370
AgentMeter [candidate] (11.545 ms) : 0, 11545
GlobalTracer [baseline] (248.4 ms) : 0, 248400
GlobalTracer [candidate] (248.251 ms) : 0, 248251
IAST [baseline] (25.289 ms) : 0, 25289
IAST [candidate] (25.367 ms) : 0, 25367
AppSec [baseline] (26.538 ms) : 0, 26538
AppSec [candidate] (26.506 ms) : 0, 26506
Debugger [baseline] (63.407 ms) : 0, 63407
Debugger [candidate] (63.897 ms) : 0, 63897
Remote Config [baseline] (521.654 µs) : 0, 522
Remote Config [candidate] (523.058 µs) : 0, 523
Telemetry [baseline] (14.96 ms) : 0, 14960
Telemetry [candidate] (14.979 ms) : 0, 14979
Flare Poller [baseline] (4.858 ms) : 0, 4858
Flare Poller [candidate] (4.977 ms) : 0, 4977
section profiling
crashtracking [baseline] (1.174 ms) : 0, 1174
crashtracking [candidate] (1.163 ms) : 0, 1163
BytebuddyAgent [baseline] (682.255 ms) : 0, 682255
BytebuddyAgent [candidate] (689.546 ms) : 0, 689546
AgentMeter [baseline] (8.539 ms) : 0, 8539
AgentMeter [candidate] (8.612 ms) : 0, 8612
GlobalTracer [baseline] (215.421 ms) : 0, 215421
GlobalTracer [candidate] (216.151 ms) : 0, 216151
AppSec [baseline] (32.037 ms) : 0, 32037
AppSec [candidate] (32.177 ms) : 0, 32177
Debugger [baseline] (62.499 ms) : 0, 62499
Debugger [candidate] (61.524 ms) : 0, 61524
Remote Config [baseline] (586.834 µs) : 0, 587
Remote Config [candidate] (589.317 µs) : 0, 589
Telemetry [baseline] (11.298 ms) : 0, 11298
Telemetry [candidate] (11.291 ms) : 0, 11291
Flare Poller [baseline] (3.539 ms) : 0, 3539
Flare Poller [candidate] (4.285 ms) : 0, 4285
ProfilingAgent [baseline] (94.426 ms) : 0, 94426
ProfilingAgent [candidate] (94.117 ms) : 0, 94117
Profiling [baseline] (94.996 ms) : 0, 94996
Profiling [candidate] (94.683 ms) : 0, 94683

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	adrien.boitreaud/spark-launcher-metrics
git_commit_date	1772556429	1772557787
git_commit_sha	`9b93366`	`891d0df`
release_version	1.61.0-SNAPSHOT~9b93366972	1.60.0-SNAPSHOT~891d0dfb55

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1772560063	1772560063
ci_job_id	1472015849	1472015849
ci_pipeline_id	100089343	100089343
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-dc401pe3 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-dc401pe3 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 0 performance regressions! Performance is the same for 17 metrics, 17 unstable metrics.

scenario	Δ mean agg_http_req_duration_p50	Δ mean agg_http_req_duration_p95	Δ mean throughput	candidate mean agg_http_req_duration_p50	candidate mean agg_http_req_duration_p95	candidate mean throughput	baseline mean agg_http_req_duration_p50	baseline mean agg_http_req_duration_p95	baseline mean throughput
scenario:load:insecure-bank:iast_GLOBAL:high_load	better [-197.764µs; -105.706µs] or [-6.843%; -3.657%]	better [-525.443µs; -163.131µs] or [-6.450%; -2.003%]	unstable [-68.400op/s; +194.212op/s] or [-5.487%; +15.578%]	2.738ms	7.802ms	1309.594op/s	2.890ms	8.146ms	1246.688op/s

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~891d0dfb55, baseline=1.61.0-SNAPSHOT~9b93366972
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.192 ms) : 1181, 1204
.   : milestone, 1192,
iast (3.089 ms) : 3049, 3128
.   : milestone, 3089,
iast_FULL (6.026 ms) : 5965, 6088
.   : milestone, 6026,
iast_GLOBAL (3.681 ms) : 3618, 3745
.   : milestone, 3681,
profiling (1.943 ms) : 1926, 1960
.   : milestone, 1943,
tracing (1.837 ms) : 1822, 1852
.   : milestone, 1837,
section candidate
no_agent (1.188 ms) : 1176, 1200
.   : milestone, 1188,
iast (3.146 ms) : 3106, 3185
.   : milestone, 3146,
iast_FULL (6.113 ms) : 6050, 6176
.   : milestone, 6113,
iast_GLOBAL (3.5 ms) : 3444, 3557
.   : milestone, 3500,
profiling (2.022 ms) : 2004, 2040
.   : milestone, 2022,
tracing (1.752 ms) : 1738, 1765
.   : milestone, 1752,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.192 ms [1.181 ms, 1.204 ms]	-
iast	3.089 ms [3.049 ms, 3.128 ms]	1.896 ms (159.0%)
iast_FULL	6.026 ms [5.965 ms, 6.088 ms]	4.834 ms (405.4%)
iast_GLOBAL	3.681 ms [3.618 ms, 3.745 ms]	2.489 ms (208.7%)
profiling	1.943 ms [1.926 ms, 1.96 ms]	750.539 µs (62.9%)
tracing	1.837 ms [1.822 ms, 1.852 ms]	644.483 µs (54.0%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.188 ms [1.176 ms, 1.2 ms]	-
iast	3.146 ms [3.106 ms, 3.185 ms]	1.957 ms (164.7%)
iast_FULL	6.113 ms [6.05 ms, 6.176 ms]	4.924 ms (414.4%)
iast_GLOBAL	3.5 ms [3.444 ms, 3.557 ms]	2.312 ms (194.6%)
profiling	2.022 ms [2.004 ms, 2.04 ms]	833.722 µs (70.2%)
tracing	1.752 ms [1.738 ms, 1.765 ms]	563.262 µs (47.4%)

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~891d0dfb55, baseline=1.61.0-SNAPSHOT~9b93366972
    dateFormat X
    axisFormat %s
section baseline
no_agent (17.99 ms) : 17808, 18173
.   : milestone, 17990,
appsec (18.651 ms) : 18463, 18838
.   : milestone, 18651,
code_origins (17.565 ms) : 17394, 17736
.   : milestone, 17565,
iast (18.667 ms) : 18479, 18854
.   : milestone, 18667,
profiling (18.706 ms) : 18524, 18887
.   : milestone, 18706,
tracing (18.08 ms) : 17902, 18258
.   : milestone, 18080,
section candidate
no_agent (18.785 ms) : 18595, 18975
.   : milestone, 18785,
appsec (18.566 ms) : 18379, 18752
.   : milestone, 18566,
code_origins (17.705 ms) : 17530, 17879
.   : milestone, 17705,
iast (18.827 ms) : 18637, 19017
.   : milestone, 18827,
profiling (18.93 ms) : 18745, 19115
.   : milestone, 18930,
tracing (17.626 ms) : 17454, 17798
.   : milestone, 17626,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	17.99 ms [17.808 ms, 18.173 ms]	-
appsec	18.651 ms [18.463 ms, 18.838 ms]	660.618 µs (3.7%)
code_origins	17.565 ms [17.394 ms, 17.736 ms]	-424.819 µs (-2.4%)
iast	18.667 ms [18.479 ms, 18.854 ms]	676.742 µs (3.8%)
profiling	18.706 ms [18.524 ms, 18.887 ms]	715.477 µs (4.0%)
tracing	18.08 ms [17.902 ms, 18.258 ms]	89.663 µs (0.5%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	18.785 ms [18.595 ms, 18.975 ms]	-
appsec	18.566 ms [18.379 ms, 18.752 ms]	-219.264 µs (-1.2%)
code_origins	17.705 ms [17.53 ms, 17.879 ms]	-1.08 ms (-5.8%)
iast	18.827 ms [18.637 ms, 19.017 ms]	41.874 µs (0.2%)
profiling	18.93 ms [18.745 ms, 19.115 ms]	144.995 µs (0.8%)
tracing	17.626 ms [17.454 ms, 17.798 ms]	-1.159 ms (-6.2%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	adrien.boitreaud/spark-launcher-metrics
git_commit_date	1772556429	1772557787
git_commit_sha	`9b93366`	`891d0df`
release_version	1.61.0-SNAPSHOT~9b93366972	1.60.0-SNAPSHOT~891d0dfb55

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1772559764	1772559764
ci_job_id	1472015851	1472015851
ci_pipeline_id	100089343	100089343
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-2-68otgtv4 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-2-68otgtv4 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 0 unstable metrics.

scenario	Δ mean execution_time	candidate mean execution_time	baseline mean execution_time
scenario:dacapo:tomcat:appsec	better [-1.391ms; -1.051ms] or [-37.129%; -28.063%]	2.525ms	3.747ms

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~891d0dfb55, baseline=1.61.0-SNAPSHOT~9b93366972
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.484 ms) : 1472, 1495
.   : milestone, 1484,
appsec (3.747 ms) : 3530, 3963
.   : milestone, 3747,
iast (2.254 ms) : 2185, 2323
.   : milestone, 2254,
iast_GLOBAL (2.303 ms) : 2233, 2372
.   : milestone, 2303,
profiling (2.088 ms) : 2034, 2143
.   : milestone, 2088,
tracing (2.072 ms) : 2018, 2125
.   : milestone, 2072,
section candidate
no_agent (1.476 ms) : 1465, 1488
.   : milestone, 1476,
appsec (2.525 ms) : 2470, 2580
.   : milestone, 2525,
iast (2.263 ms) : 2194, 2332
.   : milestone, 2263,
iast_GLOBAL (2.305 ms) : 2236, 2374
.   : milestone, 2305,
profiling (2.086 ms) : 2031, 2141
.   : milestone, 2086,
tracing (2.071 ms) : 2017, 2124
.   : milestone, 2071,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.484 ms [1.472 ms, 1.495 ms]	-
appsec	3.747 ms [3.53 ms, 3.963 ms]	2.263 ms (152.5%)
iast	2.254 ms [2.185 ms, 2.323 ms]	769.936 µs (51.9%)
iast_GLOBAL	2.303 ms [2.233 ms, 2.372 ms]	818.759 µs (55.2%)
profiling	2.088 ms [2.034 ms, 2.143 ms]	604.587 µs (40.7%)
tracing	2.072 ms [2.018 ms, 2.125 ms]	587.815 µs (39.6%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.476 ms [1.465 ms, 1.488 ms]	-
appsec	2.525 ms [2.47 ms, 2.58 ms]	1.049 ms (71.1%)
iast	2.263 ms [2.194 ms, 2.332 ms]	786.606 µs (53.3%)
iast_GLOBAL	2.305 ms [2.236 ms, 2.374 ms]	828.557 µs (56.1%)
profiling	2.086 ms [2.031 ms, 2.141 ms]	609.486 µs (41.3%)
tracing	2.071 ms [2.017 ms, 2.124 ms]	594.466 µs (40.3%)

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~891d0dfb55, baseline=1.61.0-SNAPSHOT~9b93366972
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.524 s) : 15524000, 15524000
.   : milestone, 15524000,
appsec (14.985 s) : 14985000, 14985000
.   : milestone, 14985000,
iast (17.988 s) : 17988000, 17988000
.   : milestone, 17988000,
iast_GLOBAL (17.693 s) : 17693000, 17693000
.   : milestone, 17693000,
profiling (15.601 s) : 15601000, 15601000
.   : milestone, 15601000,
tracing (15.034 s) : 15034000, 15034000
.   : milestone, 15034000,
section candidate
no_agent (15.312 s) : 15312000, 15312000
.   : milestone, 15312000,
appsec (14.842 s) : 14842000, 14842000
.   : milestone, 14842000,
iast (18.338 s) : 18338000, 18338000
.   : milestone, 18338000,
iast_GLOBAL (17.815 s) : 17815000, 17815000
.   : milestone, 17815000,
profiling (14.79 s) : 14790000, 14790000
.   : milestone, 14790000,
tracing (15.094 s) : 15094000, 15094000
.   : milestone, 15094000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.524 s [15.524 s, 15.524 s]	-
appsec	14.985 s [14.985 s, 14.985 s]	-539.0 ms (-3.5%)
iast	17.988 s [17.988 s, 17.988 s]	2.464 s (15.9%)
iast_GLOBAL	17.693 s [17.693 s, 17.693 s]	2.169 s (14.0%)
profiling	15.601 s [15.601 s, 15.601 s]	77.0 ms (0.5%)
tracing	15.034 s [15.034 s, 15.034 s]	-490.0 ms (-3.2%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.312 s [15.312 s, 15.312 s]	-
appsec	14.842 s [14.842 s, 14.842 s]	-470.0 ms (-3.1%)
iast	18.338 s [18.338 s, 18.338 s]	3.026 s (19.8%)
iast_GLOBAL	17.815 s [17.815 s, 17.815 s]	2.503 s (16.3%)
profiling	14.79 s [14.79 s, 14.79 s]	-522.0 ms (-3.4%)
tracing	15.094 s [15.094 s, 15.094 s]	-218.0 ms (-1.4%)

github-actions · 2026-03-02T17:39:55Z

Hi! 👋 Thanks for your pull request! 🎉

To help us review it, please make sure to:

Add at least one type, and one component or instrumentation label to the pull request

If you need help, please check our contributing guidelines.

aboitreaud · 2026-03-03T13:01:01Z

/merge

gh-worker-devflow-routing-ef8351 · 2026-03-03T13:01:05Z

View all feedbacks in Devflow UI.

2026-03-03 13:01:05 UTC ℹ️ Start processing command /merge

2026-03-03 13:01:16 UTC ℹ️ MergeQueue: waiting for PR to be ready

This pull request is not mergeable according to GitHub. Common reasons include pending required checks, missing approvals, or merge conflicts — but it could also be blocked by other repository rules or settings.
It will be added to the queue as soon as checks pass and/or get approvals. View in MergeQueue UI.
Note: if you pushed new commits since the last approval, you may need additional approval.
You can remove it from the waiting list with /remove command.

2026-03-03 17:06:09 UTC ⚠️ MergeQueue: This merge request was unqueued

devflow unqueued this merge request: It did not become mergeable within the expected time

dd-octo-sts · 2026-03-03T18:45:54Z

/merge

gh-worker-devflow-routing-ef8351 · 2026-03-03T18:45:58Z

View all feedbacks in Devflow UI.

2026-03-03 18:45:58 UTC ℹ️ Start processing command /merge

2026-03-03 18:46:03 UTC ℹ️ MergeQueue: pull request added to the queue

The expected merge time in master is approximately 1h (p90).

2026-03-03 20:47:07 UTC ❌ MergeQueue: The build pipeline has timeout

The merge request has been interrupted because the build 100126315 took longer than expected. The current limit for the base branch 'master' is 120 minutes.

capture latency metrics

4cbda77

aboitreaud marked this pull request as ready for review March 2, 2026 17:39

aboitreaud requested a review from a team as a code owner March 2, 2026 17:39

aboitreaud added type: enhancement Enhancements and improvements inst: apache spark Apache Spark instrumentation labels Mar 2, 2026

labbati approved these changes Mar 3, 2026

View reviewed changes

Merge branch 'master' into adrien.boitreaud/spark-launcher-metrics

891d0df

aboitreaud enabled auto-merge March 3, 2026 17:09

aboitreaud added this pull request to the merge queue Mar 3, 2026

github-merge-queue bot removed this pull request from the merge queue due to failed status checks Mar 3, 2026

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Spark Launcher instrumentation: Capture time app-related metrics#10708

Spark Launcher instrumentation: Capture time app-related metrics#10708
aboitreaud wants to merge 2 commits intomasterfrom
adrien.boitreaud/spark-launcher-metrics

aboitreaud commented Mar 1, 2026 •

edited

Loading

Uh oh!

pr-commenter bot commented Mar 1, 2026 •

edited

Loading

Uh oh!

github-actions bot commented Mar 2, 2026

Uh oh!

aboitreaud commented Mar 3, 2026

Uh oh!

gh-worker-devflow-routing-ef8351 bot commented Mar 3, 2026 •

edited

Loading

Uh oh!

dd-octo-sts bot commented Mar 3, 2026

Uh oh!

gh-worker-devflow-routing-ef8351 bot commented Mar 3, 2026 •

edited

Loading

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Conversation

aboitreaud commented Mar 1, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Motivation

Changes

Additional Notes

Contributor Checklist

Uh oh!

pr-commenter bot commented Mar 1, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

github-actions bot commented Mar 2, 2026

Uh oh!

aboitreaud commented Mar 3, 2026

Uh oh!

gh-worker-devflow-routing-ef8351 bot commented Mar 3, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

dd-octo-sts bot commented Mar 3, 2026

Uh oh!

gh-worker-devflow-routing-ef8351 bot commented Mar 3, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

aboitreaud commented Mar 1, 2026 •

edited

Loading

pr-commenter bot commented Mar 1, 2026 •

edited

Loading

gh-worker-devflow-routing-ef8351 bot commented Mar 3, 2026 •

edited

Loading

gh-worker-devflow-routing-ef8351 bot commented Mar 3, 2026 •

edited

Loading