Skip to content

Conversation

@rochdev
Copy link
Member

@rochdev rochdev commented Oct 28, 2025

What does this PR do?

Switch all sandbox usage to new helper.

Motivation

Managing things like timeouts, retries, etc for the sandbox should not have to be repeated everywhere. This will allow us to make improvements to the sandbox and address flakiness without touching so many files every time.

@github-actions
Copy link

github-actions bot commented Oct 28, 2025

Overall package size

Self size: 13.14 MB
Deduped: 117.18 MB
No deduping: 119.39 MB

Dependency sizes | name | version | self size | total size | |------|---------|-----------|------------| | @datadog/libdatadog | 0.7.0 | 35.02 MB | 35.02 MB | | @datadog/native-appsec | 10.3.0 | 20.73 MB | 20.74 MB | | @datadog/native-iast-taint-tracking | 4.0.0 | 11.72 MB | 11.73 MB | | @datadog/pprof | 5.12.0 | 11.19 MB | 11.57 MB | | @opentelemetry/core | 1.30.1 | 908.66 kB | 7.16 MB | | protobufjs | 7.5.4 | 2.95 MB | 5.82 MB | | @datadog/wasm-js-rewriter | 4.0.1 | 2.85 MB | 3.58 MB | | @opentelemetry/resources | 1.9.1 | 306.54 kB | 1.74 MB | | @datadog/native-metrics | 3.1.1 | 1.02 MB | 1.43 MB | | @opentelemetry/api-logs | 0.207.0 | 201.39 kB | 1.42 MB | | @opentelemetry/api | 1.9.0 | 1.22 MB | 1.22 MB | | jsonpath-plus | 10.3.0 | 617.18 kB | 1.08 MB | | import-in-the-middle | 1.15.0 | 127.66 kB | 856.24 kB | | lru-cache | 10.4.3 | 804.3 kB | 804.3 kB | | @datadog/openfeature-node-server | 0.1.0-preview.12 | 95.11 kB | 401.68 kB | | opentracing | 0.14.7 | 194.81 kB | 194.81 kB | | source-map | 0.7.6 | 185.63 kB | 185.63 kB | | pprof-format | 2.2.1 | 163.06 kB | 163.06 kB | | @datadog/sketches-js | 2.1.1 | 109.9 kB | 109.9 kB | | lodash.sortby | 4.7.0 | 75.76 kB | 75.76 kB | | ignore | 7.0.5 | 63.38 kB | 63.38 kB | | istanbul-lib-coverage | 3.2.2 | 34.37 kB | 34.37 kB | | rfdc | 1.4.1 | 27.15 kB | 27.15 kB | | dc-polyfill | 0.1.10 | 26.73 kB | 26.73 kB | | @isaacs/ttlcache | 1.4.1 | 25.2 kB | 25.2 kB | | tlhunter-sorted-set | 0.1.0 | 24.94 kB | 24.94 kB | | shell-quote | 1.8.3 | 23.74 kB | 23.74 kB | | limiter | 1.1.5 | 23.17 kB | 23.17 kB | | retry | 0.13.1 | 18.85 kB | 18.85 kB | | semifies | 1.0.0 | 15.84 kB | 15.84 kB | | jest-docblock | 29.7.0 | 8.99 kB | 12.76 kB | | crypto-randomuuid | 1.0.0 | 11.18 kB | 11.18 kB | | ttl-set | 1.0.0 | 4.61 kB | 9.69 kB | | mutexify | 1.4.0 | 5.71 kB | 8.74 kB | | path-to-regexp | 0.1.12 | 6.6 kB | 6.6 kB | | module-details-from-path | 1.0.4 | 3.96 kB | 3.96 kB | | escape-string-regexp | 5.0.0 | 3.66 kB | 3.66 kB |

🤖 This report was automatically generated by heaviest-objects-in-the-universe

@codecov
Copy link

codecov bot commented Oct 28, 2025

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 83.79%. Comparing base (091130d) to head (fc3a5c2).
⚠️ Report is 1 commits behind head on master.

Additional details and impacted files
@@           Coverage Diff           @@
##           master    #6777   +/-   ##
=======================================
  Coverage   83.79%   83.79%           
=======================================
  Files         506      506           
  Lines       21270    21270           
=======================================
  Hits        17824    17824           
  Misses       3446     3446           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@datadog-datadog-prod-us1

This comment has been minimized.

@pr-commenter
Copy link

pr-commenter bot commented Oct 28, 2025

Benchmarks

Benchmark execution time: 2025-10-31 16:06:43

Comparing candidate commit fc3a5c2 in PR branch use-sandbox-everywhere with baseline commit 091130d in branch master.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 1607 metrics, 63 unstable metrics.

@rochdev rochdev marked this pull request as ready for review October 29, 2025 05:05
@rochdev rochdev requested review from a team as code owners October 29, 2025 05:05
@rochdev rochdev requested review from BridgeAR and removed request for a team October 29, 2025 05:05
@rochdev rochdev force-pushed the use-sandbox-everywhere branch from d484506 to 8c7327a Compare October 30, 2025 18:41

after(async () => {
await sandbox.remove()
execSync('yarn exec next build', {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why was this addition needed?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's better to run the command in its own before hook so that it's isolated from the sandbox instead of passing it for the sandbox to run. I would like to eventually deprecate passing additional commands to the sandbox.

pabloerhard
pabloerhard previously approved these changes Oct 31, 2025
juan-fernandez
juan-fernandez previously approved these changes Oct 31, 2025
Copy link
Collaborator

@juan-fernandez juan-fernandez left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM from test optimization's perspective.

@rochdev rochdev dismissed stale reviews from juan-fernandez and pabloerhard via fc3a5c2 October 31, 2025 15:57
@rochdev rochdev force-pushed the use-sandbox-everywhere branch from 1166d87 to fc3a5c2 Compare October 31, 2025 15:57
@rochdev rochdev merged commit 3522ff7 into master Oct 31, 2025
763 checks passed
@rochdev rochdev deleted the use-sandbox-everywhere branch October 31, 2025 16:19
dd-octo-sts bot pushed a commit that referenced this pull request Nov 1, 2025
@dd-octo-sts dd-octo-sts bot mentioned this pull request Nov 1, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants