Skip to content

ci(codecov): simplify codecov configuration #1335

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Draft
wants to merge 2 commits into
base: main
Choose a base branch
from
Draft

ci(codecov): simplify codecov configuration #1335

wants to merge 2 commits into from

Conversation

@bantonsson
Copy link
Contributor

@bantonsson bantonsson commented Nov 11, 2025

What does this PR do?

A brief description of the change being made with this pull request.

Motivation

What inspired you to submit this pull request?

Additional Notes

Anything else we should know when reviewing?

How to test the change?

Describe here in detail how the change can be validated.

@codecov-commenter
Copy link

codecov-commenter commented Nov 11, 2025 •
edited
Loading

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 72.04%. Comparing base (3e9119a) to head (a99e306).
⚠️ Report is 4 commits behind head on main.

Additional details and impacted files 
@@            Coverage Diff             @@
##             main    #1335      +/-   ##
==========================================
+ Coverage   70.95%   72.04%   +1.09%     
==========================================
  Files         390      373      -17     
  Lines       62562    61479    -1083     
==========================================
- Hits        44389    44293      -96     
+ Misses      18173    17186     -987
Components Coverage Δ
libdd-crashtracker 57.81% <ø> (+0.16%) ⬆️
libdd-crashtracker-ffi 15.31% <ø> (+0.70%) ⬆️
libdd-alloc 98.73% <ø> (ø)
libdd-data-pipeline 86.00% <ø> (-0.02%) ⬇️
libdd-data-pipeline-ffi 77.63% <ø> (-0.11%) ⬇️
libdd-common 80.93% <ø> (ø)
libdd-common-ffi 73.90% <ø> (ø)
libdd-telemetry 60.02% <ø> (ø)
libdd-telemetry-ffi 21.24% <ø> (ø)
libdd-dogstatsd-client 83.75% <ø> (ø)
datadog-ipc 82.61% <ø> (ø)
libdd-profiling 79.65% <ø> (ø)
libdd-profiling-ffi 62.13% <ø> (ø)
datadog-sidecar 36.98% <ø> (+1.07%) ⬆️
datdog-sidecar-ffi 16.40% <ø> (+5.41%) ⬆️
spawn-worker 55.18% <ø> (ø)
libdd-tinybytes 92.44% <ø> (ø)
libdd-trace-normalization 98.24% <ø> (ø)
datadog-trace-obfuscation 94.17% <ø> (ø)
libdd-trace-protobuf 59.65% <ø> (ø)
libdd-trace-utils 90.25% <ø> (+0.17%) ⬆️
datadog-tracer-flare 62.06% <ø> (-1.43%) ⬇️
libdd-log 75.57% <ø> (ø)
🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@pr-commenter
Copy link

pr-commenter bot commented Nov 11, 2025 •
edited
Loading

Benchmarks

Comparison

Benchmark execution time: 2025-11-19 15:11:43

Comparing candidate commit a99e306 in PR branch ban/simplify-codecov with baseline commit 3e9119a in branch main.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 55 metrics, 2 unstable metrics.

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a99e306 1763564198 ban/simplify-codecov
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 33.866µs 34.456µs ± 0.938µs 34.018µs ± 0.032µs 34.112µs 36.429µs 36.506µs 38.004µs 11.72% 1.758 1.377 2.72% 0.066µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [34.326µs; 34.586µs] or [-0.377%; +0.377%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a99e306 1763564198 ban/simplify-codecov
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 10.604ms 10.629ms ± 0.014ms 10.627ms ± 0.008ms 10.636ms 10.652ms 10.676ms 10.717ms 0.85% 2.029 8.662 0.13% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [10.627ms; 10.631ms] or [-0.019%; +0.019%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a99e306 1763564198 ban/simplify-codecov
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
single_flag_killswitch/rules-based execution_time 190.305ns 192.867ns ± 1.953ns 192.591ns ± 1.223ns 193.648ns 196.645ns 199.055ns 201.081ns 4.41% 1.246 1.914 1.01% 0.138ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
single_flag_killswitch/rules-based execution_time [192.596ns; 193.138ns] or [-0.140%; +0.140%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a99e306 1763564198 ban/simplify-codecov
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 5.032µs 5.098µs ± 0.035µs 5.094µs ± 0.029µs 5.132µs 5.157µs 5.162µs 5.166µs 1.40% 0.296 -1.224 0.68% 0.002µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.094µs; 5.103µs] or [-0.094%; +0.094%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a99e306 1763564198 ban/simplify-codecov
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 85.980µs 86.222µs ± 0.154µs 86.196µs ± 0.051µs 86.254µs 86.397µs 86.533µs 87.947µs 2.03% 7.275 77.382 0.18% 0.011µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [86.200µs; 86.243µs] or [-0.025%; +0.025%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a99e306 1763564198 ban/simplify-codecov
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.894µs 3.916µs ± 0.003µs 3.915µs ± 0.002µs 3.918µs 3.920µs 3.921µs 3.923µs 0.19% -1.673 11.755 0.08% 0.000µs 1 200
credit_card/is_card_number/ throughput 254919777.095op/s 255380036.559op/s ± 200488.169op/s 255396589.921op/s ± 138319.500op/s 255502210.103op/s 255634674.739op/s 255726669.424op/s 256827128.504op/s 0.56% 1.699 11.977 0.08% 14176.654op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 77.870µs 79.366µs ± 0.748µs 79.333µs ± 0.538µs 79.883µs 80.733µs 80.911µs 81.093µs 2.22% 0.179 -0.633 0.94% 0.053µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 12331535.082op/s 12600897.295op/s ± 118593.789op/s 12605039.100op/s ± 85500.108op/s 12688511.714op/s 12786543.610op/s 12828403.771op/s 12841885.910op/s 1.88% -0.141 -0.643 0.94% 8385.847op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 71.445µs 71.772µs ± 0.342µs 71.668µs ± 0.101µs 71.802µs 72.588µs 73.345µs 73.568µs 2.65% 2.676 8.255 0.48% 0.024µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 13592940.370op/s 13933351.368op/s ± 65583.140op/s 13953238.513op/s ± 19675.625op/s 13969812.284op/s 13985723.098op/s 13993218.522op/s 13996724.766op/s 0.31% -2.633 7.961 0.47% 4637.428op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.895µs 3.915µs ± 0.003µs 3.915µs ± 0.002µs 3.917µs 3.921µs 3.923µs 3.924µs 0.24% -0.729 6.929 0.08% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 254816581.927op/s 255413014.540op/s ± 205612.842op/s 255426437.221op/s ± 115558.748op/s 255533902.963op/s 255681174.411op/s 255732378.644op/s 256708893.521op/s 0.50% 0.749 7.052 0.08% 14539.024op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 68.391µs 68.731µs ± 0.460µs 68.534µs ± 0.081µs 68.787µs 69.495µs 70.563µs 71.135µs 3.79% 2.621 8.011 0.67% 0.033µs 1 200
credit_card/is_card_number/378282246310005 throughput 14057848.717op/s 14550031.725op/s ± 95770.205op/s 14591277.473op/s ± 17212.753op/s 14603767.017op/s 14616006.343op/s 14617581.050op/s 14621792.419op/s 0.21% -2.560 7.588 0.66% 6771.976op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 45.457µs 45.653µs ± 0.072µs 45.651µs ± 0.049µs 45.710µs 45.762µs 45.811µs 45.836µs 0.41% -0.107 -0.186 0.16% 0.005µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 21816714.692op/s 21904410.297op/s ± 34629.106op/s 21905272.600op/s ± 23738.698op/s 21924532.463op/s 21966698.145op/s 21978615.554op/s 21998575.617op/s 0.43% 0.115 -0.185 0.16% 2448.648op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 6.552µs 6.622µs ± 0.019µs 6.627µs ± 0.011µs 6.636µs 6.644µs 6.647µs 6.649µs 0.34% -1.127 1.038 0.28% 0.001µs 1 200
credit_card/is_card_number/x371413321323331 throughput 150399783.727op/s 151011579.636op/s ± 424688.928op/s 150904842.576op/s ± 249922.403op/s 151207959.249op/s 151836333.646op/s 152223819.989op/s 152636700.510op/s 1.15% 1.142 1.090 0.28% 30030.042op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.898µs 3.916µs ± 0.003µs 3.916µs ± 0.002µs 3.917µs 3.920µs 3.921µs 3.921µs 0.15% -1.193 7.319 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 255017481.423op/s 255394076.538op/s ± 173274.358op/s 255391343.754op/s ± 114825.569op/s 255505397.589op/s 255623636.218op/s 255680332.106op/s 256521313.959op/s 0.44% 1.209 7.438 0.07% 12252.347op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 65.577µs 65.710µs ± 0.053µs 65.705µs ± 0.035µs 65.743µs 65.804µs 65.834µs 65.869µs 0.25% 0.233 0.122 0.08% 0.004µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 15181652.943op/s 15218386.937op/s ± 12301.654op/s 15219516.158op/s ± 8029.656op/s 15226722.164op/s 15236354.265op/s 15245834.555op/s 15249223.137op/s 0.20% -0.228 0.120 0.08% 869.858op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 53.363µs 53.429µs ± 0.034µs 53.422µs ± 0.021µs 53.449µs 53.493µs 53.519µs 53.550µs 0.24% 0.869 0.687 0.06% 0.002µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 18674062.125op/s 18716339.516op/s ± 11756.075op/s 18718780.149op/s ± 7368.392op/s 18724596.518op/s 18732475.701op/s 18734114.797op/s 18739744.226op/s 0.11% -0.866 0.678 0.06% 831.280op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.895µs 3.915µs ± 0.003µs 3.915µs ± 0.002µs 3.917µs 3.920µs 3.921µs 3.923µs 0.21% -1.250 9.574 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 254887378.187op/s 255418468.372op/s ± 189864.804op/s 255426667.007op/s ± 106940.614op/s 255522543.478op/s 255669118.742op/s 255758658.114op/s 256713665.195op/s 0.50% 1.272 9.736 0.07% 13425.469op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 50.154µs 50.211µs ± 0.030µs 50.208µs ± 0.021µs 50.230µs 50.261µs 50.290µs 50.308µs 0.20% 0.512 -0.070 0.06% 0.002µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 19877372.513op/s 19915908.245op/s ± 11936.656op/s 19917089.143op/s ± 8442.952op/s 19925407.245op/s 19933214.065op/s 19936960.328op/s 19938601.072op/s 0.11% -0.509 -0.075 0.06% 844.049op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 45.473µs 45.683µs ± 0.091µs 45.672µs ± 0.064µs 45.743µs 45.831µs 45.906µs 46.080µs 0.89% 0.629 1.063 0.20% 0.006µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 21701416.845op/s 21890247.013op/s ± 43386.240op/s 21895131.621op/s ± 30908.741op/s 21921928.507op/s 21950302.529op/s 21968830.282op/s 21991027.460op/s 0.44% -0.614 1.012 0.20% 3067.870op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 6.565µs 6.619µs ± 0.019µs 6.620µs ± 0.015µs 6.635µs 6.641µs 6.650µs 6.651µs 0.46% -0.533 -0.444 0.28% 0.001µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 150363162.317op/s 151091699.559op/s ± 426240.444op/s 151057462.158op/s ± 344908.223op/s 151409730.423op/s 151900580.756op/s 152108723.820op/s 152325700.336op/s 0.84% 0.543 -0.427 0.28% 30139.751op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.915µs; 3.916µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/ throughput [255352250.827op/s; 255407822.291op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [79.263µs; 79.470µs] or [-0.131%; +0.131%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [12584461.336op/s; 12617333.253op/s] or [-0.130%; +0.130%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [71.724µs; 71.819µs] or [-0.066%; +0.066%] None None None
credit_card/is_card_number/ 378282246310005 throughput [13924262.175op/s; 13942440.560op/s] or [-0.065%; +0.065%] None None None
credit_card/is_card_number/37828224631 execution_time [3.915µs; 3.916µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/37828224631 throughput [255384518.577op/s; 255441510.502op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/378282246310005 execution_time [68.668µs; 68.795µs] or [-0.093%; +0.093%] None None None
credit_card/is_card_number/378282246310005 throughput [14536758.896op/s; 14563304.555op/s] or [-0.091%; +0.091%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [45.643µs; 45.663µs] or [-0.022%; +0.022%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [21899611.036op/s; 21909209.558op/s] or [-0.022%; +0.022%] None None None
credit_card/is_card_number/x371413321323331 execution_time [6.619µs; 6.625µs] or [-0.039%; +0.039%] None None None
credit_card/is_card_number/x371413321323331 throughput [150952721.835op/s; 151070437.437op/s] or [-0.039%; +0.039%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.915µs; 3.916µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/ throughput [255370062.379op/s; 255418090.698op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [65.703µs; 65.717µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [15216682.046op/s; 15220091.828op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [53.425µs; 53.434µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [18714710.237op/s; 18717968.795op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.915µs; 3.916µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [255392154.937op/s; 255444781.808op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [50.207µs; 50.215µs] or [-0.008%; +0.008%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [19914253.939op/s; 19917562.551op/s] or [-0.008%; +0.008%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [45.670µs; 45.695µs] or [-0.028%; +0.028%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [21884234.097op/s; 21896259.928op/s] or [-0.027%; +0.027%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [6.616µs; 6.621µs] or [-0.039%; +0.039%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [151032626.733op/s; 151150772.385op/s] or [-0.039%; +0.039%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a99e306 1763564198 ban/simplify-codecov
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.330µs 2.406µs ± 0.018µs 2.406µs ± 0.007µs 2.415µs 2.429µs 2.435µs 2.441µs 1.48% -1.908 5.169 0.76% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.403µs; 2.408µs] or [-0.106%; +0.106%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a99e306 1763564198 ban/simplify-codecov
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
receiver_entry_point/report/2597 execution_time 6.113ms 6.392ms ± 0.066ms 6.409ms ± 0.013ms 6.420ms 6.440ms 6.478ms 6.577ms 2.61% -2.366 6.384 1.02% 0.005ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
receiver_entry_point/report/2597 execution_time [6.383ms; 6.401ms] or [-0.142%; +0.142%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a99e306 1763564198 ban/simplify-codecov
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching serializing traces from their internal representation to msgpack execution_time 14.810ms 14.882ms ± 0.032ms 14.878ms ± 0.015ms 14.893ms 14.926ms 15.022ms 15.032ms 1.04% 2.182 7.309 0.22% 0.002ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching serializing traces from their internal representation to msgpack execution_time [14.878ms; 14.887ms] or [-0.030%; +0.030%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a99e306 1763564198 ban/simplify-codecov
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 534.012µs 535.038µs ± 1.187µs 534.844µs ± 0.297µs 535.151µs 535.701µs 542.965µs 543.445µs 1.61% 5.672 35.042 0.22% 0.084µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1840113.412op/s 1869036.137op/s ± 4096.452op/s 1869703.549op/s ± 1036.919op/s 1870669.297op/s 1871668.118op/s 1872410.586op/s 1872615.445op/s 0.16% -5.639 34.752 0.22% 289.663op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 380.188µs 380.849µs ± 0.335µs 380.802µs ± 0.231µs 381.073µs 381.425µs 381.608µs 381.741µs 0.25% 0.437 -0.471 0.09% 0.024µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2619577.148op/s 2625717.449op/s ± 2308.242op/s 2626036.928op/s ± 1592.543op/s 2627436.827op/s 2628979.041op/s 2629899.071op/s 2630276.449op/s 0.16% -0.434 -0.475 0.09% 163.217op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 195.286µs 195.793µs ± 0.231µs 195.775µs ± 0.165µs 195.958µs 196.195µs 196.383µs 196.532µs 0.39% 0.327 -0.071 0.12% 0.016µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5088225.819op/s 5107454.974op/s ± 6024.114op/s 5107901.049op/s ± 4313.193op/s 5111683.388op/s 5116366.712op/s 5120006.113op/s 5120700.296op/s 0.25% -0.320 -0.078 0.12% 425.969op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 37.049µs 37.248µs ± 0.090µs 37.250µs ± 0.057µs 37.301µs 37.398µs 37.470µs 37.690µs 1.18% 0.697 2.287 0.24% 0.006µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 26532179.369op/s 26846933.609op/s ± 65087.970op/s 26845497.255op/s ± 41480.053op/s 26890974.920op/s 26952761.885op/s 26972279.327op/s 26991048.858op/s 0.54% -0.669 2.178 0.24% 4602.415op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 44.901µs 45.095µs ± 0.167µs 45.082µs ± 0.113µs 45.192µs 45.312µs 45.348µs 46.555µs 3.27% 3.395 27.608 0.37% 0.012µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 21479749.489op/s 22175870.773op/s ± 80927.089op/s 22181649.057op/s ± 55650.344op/s 22238676.100op/s 22269557.404op/s 22270935.963op/s 22271312.594op/s 0.40% -3.202 25.412 0.36% 5722.409op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [534.873µs; 535.202µs] or [-0.031%; +0.031%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1868468.408op/s; 1869603.866op/s] or [-0.030%; +0.030%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [380.802µs; 380.895µs] or [-0.012%; +0.012%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2625397.549op/s; 2626037.349op/s] or [-0.012%; +0.012%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [195.760µs; 195.825µs] or [-0.016%; +0.016%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5106620.090op/s; 5108289.858op/s] or [-0.016%; +0.016%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [37.236µs; 37.261µs] or [-0.034%; +0.034%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [26837913.043op/s; 26855954.176op/s] or [-0.034%; +0.034%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [45.072µs; 45.118µs] or [-0.051%; +0.051%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [22164655.057op/s; 22187086.489op/s] or [-0.051%; +0.051%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a99e306 1763564198 ban/simplify-codecov
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 158.461µs 159.341µs ± 0.257µs 159.314µs ± 0.106µs 159.438µs 159.733µs 160.068µs 161.244µs 1.21% 1.984 15.976 0.16% 0.018µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [159.306µs; 159.377µs] or [-0.022%; +0.022%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a99e306 1763564198 ban/simplify-codecov
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 243.849ns 253.830ns ± 13.037ns 248.085ns ± 2.636ns 253.890ns 285.256ns 295.694ns 301.435ns 21.51% 1.916 2.673 5.12% 0.922ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [252.023ns; 255.636ns] or [-0.712%; +0.712%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a99e306 1763564198 ban/simplify-codecov
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.161µs 3.272µs ± 1.452µs 3.025µs ± 0.033µs 3.059µs 3.695µs 14.371µs 14.959µs 394.52% 7.222 53.755 44.25% 0.103µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [3.071µs; 3.473µs] or [-6.148%; +6.148%] None None None

Group 14

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a99e306 1763564198 ban/simplify-codecov
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 18.151µs 23.428µs ± 8.845µs 18.472µs ± 0.105µs 28.925µs 42.644µs 43.381µs 62.562µs 238.69% 1.641 1.979 37.66% 0.625µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [22.202µs; 24.654µs] or [-5.232%; +5.232%] None None None

Group 15

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a99e306 1763564198 ban/simplify-codecov
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 206.281µs 207.058µs ± 0.299µs 207.025µs ± 0.197µs 207.258µs 207.605µs 207.729µs 207.815µs 0.38% 0.223 -0.154 0.14% 0.021µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 4811976.567op/s 4829584.637op/s ± 6969.570op/s 4830329.771op/s ± 4606.366op/s 4834550.731op/s 4840712.560op/s 4843854.545op/s 4847752.405op/s 0.36% -0.215 -0.155 0.14% 492.823op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 18.163µs 18.246µs ± 0.059µs 18.237µs ± 0.030µs 18.267µs 18.325µs 18.476µs 18.543µs 1.68% 1.829 5.680 0.32% 0.004µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 53929366.126op/s 54806858.458op/s ± 177065.051op/s 54834224.416op/s ± 89128.668op/s 54922092.556op/s 55042996.561op/s 55053301.105op/s 55057875.543op/s 0.41% -1.787 5.468 0.32% 12520.390op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 10.581µs 10.734µs ± 0.066µs 10.733µs ± 0.045µs 10.778µs 10.839µs 10.904µs 10.934µs 1.87% 0.190 0.036 0.62% 0.005µs 1 200
normalization/normalize_name/normalize_name/good throughput 91459382.185op/s 93168227.932op/s ± 574529.849op/s 93169360.071op/s ± 386707.629op/s 93547254.349op/s 94106885.675op/s 94335889.807op/s 94505246.859op/s 1.43% -0.154 0.004 0.62% 40625.395op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [207.016µs; 207.099µs] or [-0.020%; +0.020%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [4828618.722op/s; 4830550.553op/s] or [-0.020%; +0.020%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [18.238µs; 18.254µs] or [-0.045%; +0.045%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [54782318.945op/s; 54831397.971op/s] or [-0.045%; +0.045%] None None None
normalization/normalize_name/normalize_name/good execution_time [10.724µs; 10.743µs] or [-0.086%; +0.086%] None None None
normalization/normalize_name/normalize_name/good throughput [93088603.621op/s; 93247852.244op/s] or [-0.085%; +0.085%] None None None

Group 16

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a99e306 1763564198 ban/simplify-codecov
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 62.872ms 63.323ms ± 1.931ms 63.059ms ± 0.093ms 63.161ms 63.441ms 74.278ms 82.723ms 31.18% 8.400 72.191 3.04% 0.137ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [63.056ms; 63.591ms] or [-0.423%; +0.423%] None None None

Group 17

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a99e306 1763564198 ban/simplify-codecov
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sdk_test_data/rules-based execution_time 144.649µs 146.558µs ± 1.717µs 146.260µs ± 0.603µs 146.919µs 148.426µs 152.908µs 162.391µs 11.03% 5.203 39.267 1.17% 0.121µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sdk_test_data/rules-based execution_time [146.320µs; 146.796µs] or [-0.162%; +0.162%] None None None

Baseline

Omitted due to size.

@bantonsson bantonsson force-pushed the ban/simplify-codecov branch 7 times, most recently from 4621ad0 to abedef5 Compare November 12, 2025 08:44
@dd-octo-sts
Copy link

dd-octo-sts bot commented Nov 12, 2025 •
edited
Loading

Artifact Size Benchmark Report

aarch64-alpine-linux-musl
Artifact Baseline Commit Change
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.so 7.57 MB 7.50 MB --.82% (-64.00 KB) 💪
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.a 83.05 MB 83.00 MB --.05% (-49.22 KB) 💪
aarch64-unknown-linux-gnu
Artifact Baseline Commit Change
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.so 9.55 MB 9.55 MB +.01% (+1.43 KB) 🔍
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.a 96.25 MB 96.28 MB +.03% (+35.14 KB) 🔍
libdatadog-x64-windows
Artifact Baseline Commit Change
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.dll 19.07 MB 19.07 MB +0% (+512 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.lib 65.49 KB 65.49 KB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.pdb 132.16 MB 132.16 MB -0% (-8.00 KB) 👌
/libdatadog-x64-windows/debug/static/datadog_profiling_ffi.lib 696.66 MB 701.00 MB +.62% (+4.33 MB) 🔍
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.dll 6.34 MB 6.34 MB +.05% (+3.50 KB) 🔍
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.lib 65.49 KB 65.49 KB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.pdb 19.07 MB 19.05 MB --.08% (-16.00 KB) 💪
/libdatadog-x64-windows/release/static/datadog_profiling_ffi.lib 36.91 MB 37.27 MB +.96% (+365.31 KB) 🔍
libdatadog-x86-windows
Artifact Baseline Commit Change
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.dll 16.16 MB 16.17 MB +.05% (+9.50 KB) 🔍
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.lib 66.50 KB 66.50 KB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.pdb 134.40 MB 134.30 MB --.07% (-104.00 KB) 💪
/libdatadog-x86-windows/debug/static/datadog_profiling_ffi.lib 684.68 MB 688.20 MB +.51% (+3.51 MB) 🔍
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.dll 4.86 MB 4.86 MB --.06% (-3.00 KB) 💪
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.lib 66.50 KB 66.50 KB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.pdb 20.23 MB 20.21 MB --.11% (-24.00 KB) 💪
/libdatadog-x86-windows/release/static/datadog_profiling_ffi.lib 34.65 MB 34.99 MB +.96% (+343.27 KB) 🔍
x86_64-alpine-linux-musl
Artifact Baseline Commit Change
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.a 71.98 MB 71.93 MB --.06% (-50.02 KB) 💪
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.so 8.92 MB 8.93 MB +.08% (+8.00 KB) 🔍
x86_64-unknown-linux-gnu
Artifact Baseline Commit Change
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.a 90.98 MB 90.95 MB --.03% (-31.48 KB) 💪
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.so 10.27 MB 10.28 MB +.01% (+1.39 KB) 🔍

@bantonsson bantonsson force-pushed the ban/simplify-codecov branch 3 times, most recently from 2cdfe59 to 163f416 Compare November 12, 2025 10:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

ci-build

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@bantonsson @codecov-commenter