Skip to content

WAL checkpointing: Explicitly checkpoint after common/large writes#90

Open
Qqwy wants to merge 1 commit intomasterfrom
wal-explicit_checkpointing_after_writes
Open

WAL checkpointing: Explicitly checkpoint after common/large writes#90
Qqwy wants to merge 1 commit intomasterfrom
wal-explicit_checkpointing_after_writes

Conversation

@Qqwy
Copy link
Copy Markdown
Contributor

@Qqwy Qqwy commented Apr 1, 2026

Follow-up of #89

  • Ensures we use the periodic checkpointing time interval in Skip mode rather than Burst
  • Always checkpoint after inserting a new submission. This is a protection against the situations in which submissions with many thousands of chunks are added, which is the failure we saw today.
  • Checkpoint every 100 chunks that are completed.

The last two situations already have a write connection at the time they get to running the checkpoint query, which will make checkpoint-starvation (which in all likelihood is what we saw before) improbable.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant