Skip to content

refactor: build graphs in parrallel using rayon#1006

Open
fayekelmith wants to merge 7 commits intostakwork:mainfrom
fayekelmith:feat/parrelize-graph-building
Open

refactor: build graphs in parrallel using rayon#1006
fayekelmith wants to merge 7 commits intostakwork:mainfrom
fayekelmith:feat/parrelize-graph-building

Conversation

@fayekelmith
Copy link
Collaborator

@fayekelmith fayekelmith commented Feb 11, 2026

Tested with Sphinx-bounties site:

  • Ingestion time Before: around 26 minutes: 1626s
  • ingestion time After: around 17 minutes: 1035s
    around 36% increase in speed.

@Evanfeenstra
Copy link
Collaborator

Why only use parallel if using Neo4jGraph?

@Evanfeenstra
Copy link
Collaborator

if no lsp then do this rayon flow

@fayekelmith fayekelmith force-pushed the feat/parrelize-graph-building branch from a85ab66 to 4374e95 Compare February 12, 2026 16:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants