Skip to content

Conversation

@zaidoon1
Copy link
Contributor

@zaidoon1 zaidoon1 commented Nov 8, 2025

resolve #190

@marvin-j97 marvin-j97 added this to the 3.0.0 milestone Nov 8, 2025
@zaidoon1 zaidoon1 force-pushed the zaidoon/ingestion-api-inversion-control branch 3 times, most recently from a043736 to 14ef584 Compare November 10, 2025 03:45
@marvin-j97
Copy link
Contributor

I'm currently massively simplifying the flush logic such that is gets really easy to flush active and sealed memtables in one go by just calling Tree::rotate_memtable followed by Tree::flush while holding a lock.
That also simplifies the flushing logic in fjall.

@marvin-j97
Copy link
Contributor

marvin-j97 commented Nov 11, 2025

(Forgot to submit comments)

But as I said, I am currently changing the Flush API which should make the ingestion API much simpler.

(WIP at #194)

@zaidoon1 zaidoon1 force-pushed the zaidoon/ingestion-api-inversion-control branch 3 times, most recently from 1af202a to 87c7d03 Compare November 15, 2025 08:10
@zaidoon1 zaidoon1 force-pushed the zaidoon/ingestion-api-inversion-control branch from 87c7d03 to 36b2651 Compare November 15, 2025 08:38
@zaidoon1 zaidoon1 requested a review from marvin-j97 November 15, 2025 08:48
Comment on lines 193 to 194
false,
false,
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I forgot to document this - but I purposefully avoided using the config for pinning because when you ingest a very large database it is assigned to L1 and will pin all those blocks which could provoke OOM.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

updated

@zaidoon1 zaidoon1 requested a review from marvin-j97 November 15, 2025 14:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Expose Ingestion API with Inversion of Control

2 participants