Skip to content

perf: event-driven completion signaling#1128

Closed
vringar wants to merge 2 commits intorefactor/storage-interfacefrom
refactor/event-driven-completion
Closed

perf: event-driven completion signaling#1128
vringar wants to merge 2 commits intorefactor/storage-interfacefrom
refactor/event-driven-completion

Conversation

@vringar
Copy link
Contributor

@vringar vringar commented Feb 19, 2026

Summary

  • Replace sleep(1) polling in _mark_command_sequences_complete with blocking completion_queue.get(timeout=1), so callbacks fire as soon as data is available
  • Reduce update_completion_queue polling interval from 5s to 0.5s in StorageController

Combined, this reduces visit completion latency from up to 6s to near-instant.

Stacked on #1127.

@codecov
Copy link

codecov bot commented Feb 19, 2026

Codecov Report

❌ Patch coverage is 0% with 11 lines in your changes missing coverage. Please review.
✅ Project coverage is 35.25%. Comparing base (f286084) to head (8a2744c).

Files with missing lines Patch % Lines
openwpm/task_manager.py 0.00% 6 Missing ⚠️
openwpm/browser_manager.py 0.00% 2 Missing ⚠️
openwpm/commands/browser_commands.py 0.00% 2 Missing ⚠️
openwpm/storage/storage_controller.py 0.00% 1 Missing ⚠️

❌ Your project check has failed because the head coverage (35.25%) is below the target coverage (40.00%). You can increase the head coverage or adjust the target coverage.

Additional details and impacted files
@@                      Coverage Diff                       @@
##           refactor/storage-interface    #1128      +/-   ##
==============================================================
- Coverage                       35.94%   35.25%   -0.70%     
==============================================================
  Files                              39       39              
  Lines                            3611     3617       +6     
==============================================================
- Hits                             1298     1275      -23     
- Misses                           2313     2342      +29     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@vringar vringar force-pushed the refactor/event-driven-completion branch from 31054e1 to e450b63 Compare February 20, 2026 12:17
@vringar vringar force-pushed the refactor/reduce-sleeps branch from 182967b to d22e33c Compare February 20, 2026 12:17
@vringar vringar changed the base branch from refactor/reduce-sleeps to master February 20, 2026 12:21
@vringar vringar changed the base branch from master to refactor/reduce-sleeps February 20, 2026 12:24
@vringar vringar force-pushed the refactor/reduce-sleeps branch from d22e33c to d8a34a1 Compare February 20, 2026 12:41
@vringar vringar force-pushed the refactor/event-driven-completion branch from e450b63 to 09e5fc7 Compare February 20, 2026 12:41
@vringar vringar changed the base branch from refactor/reduce-sleeps to refactor/storage-interface February 20, 2026 12:54
@vringar vringar force-pushed the refactor/event-driven-completion branch from 09e5fc7 to 8a2744c Compare February 20, 2026 12:55
Reduce update_completion_queue sleep from 5s to 0.5s so finalized visits
reach the completion queue faster. Keep as fallback for the blocking
get() on the TaskManager side.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant