[Performance] Importing openaire dataset with neug is about 4x slower than with neo4j #72
Description
When importing openaire with neug, it costs 418s:
rver.cpp:646: Data import request for path: /mnt/lyk/openaire_scripts/output/
Loading graph from folder: /mnt/lyk/openaire_scripts/output/
================================================
NeuG Graph Loading from: /mnt/lyk/openaire_scripts/output/
================================================
=== Opening Database ===
Database path: /tmp/p/neug_db/neug_db_1773658561843
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260316 18:56:01.843528 1046786 neug_db.cc:207] Creating NeugDB with: /tmp/p/neug_db/neug_db_1773658561843 in READ_WRITE mode
I20260316 18:56:01.844008 1046786 property_graph.cc:830] Schema file not found, build empty graph
I20260316 18:56:01.844357 1046786 neug_db.cc:254] Ingesting update wals size: 0
I20260316 18:56:01.844393 1046786 neug_db.cc:276] Finish ingesting wals up to timestamp: 0
I20260316 18:56:01.845423 1046786 neug_db.cc:137] NeugDB opened successfully
Database opened successfully
Connected to database
=== Creating schema from schema.json ===
Creating Author node table
Query: CREATE NODE TABLE Author(id INT64 PRIMARY KEY, label STRING, fullName STRING, name STRING, surname STRING, orcid STRING, idtype STRING, organization STRING, country STRING)
I20260316 18:56:01.845878 1046786 connection.cc:47] Query: CREATE NODE TABLE Author(id INT64 PRIMARY KEY, label STRING, fullName STRING, name STRING, surname STRING, orcid STRING, idtype STRING, organization STRING, country STRING)
I20260316 18:56:01.845899 1046786 query_processor.cc:36] Executing plan with 52 threads, max_num_threads: 52
I20260316 18:56:01.845935 1046786 gopt_planner.cc:29] [GOptPlanner] compilePlan called with query: CREATE NODE TABLE Author(id INT64 PRIMARY KEY, label STRING, fullName STRING, name STRING, surname STRING, orcid STRING, idtype STRING, organization STRING, country STRING)
I20260316 18:56:01.857263 1046786 pb_utils.cc:916] Setting string value: for type: StringView
I20260316 18:56:01.857309 1046786 pb_utils.cc:916] Setting string value: for type: StringView
I20260316 18:56:01.857322 1046786 pb_utils.cc:916] Setting string value: for type: StringView
I20260316 18:56:01.857331 1046786 pb_utils.cc:916] Setting string value: for type: StringView
I20260316 18:56:01.857348 1046786 pb_utils.cc:916] Setting string value: for type: StringView
I20260316 18:56:01.857358 1046786 pb_utils.cc:916] Setting string value: for type: StringView
I20260316 18:56:01.857367 1046786 pb_utils.cc:916] Setting string value: for type: StringView
I20260316 18:56:01.857378 1046786 pb_utils.cc:916] Setting string value: for type: StringView
I20260316 18:56:01.857892 1046786 property_graph.cc:236] CreateVertexType: vertex_type_name: Author, vertex_label_id: 0,properties 8, primary_key_names: id
I20260316 18:56:01.858115 1046786 query_processor.cc:144] Updating compiler meta if needed.
Created vertex table: Author (9 columns)
Creating Community node table
Query: CREATE NODE TABLE Community(id INT64 PRIMARY KEY, label STRING, acronym STRING, name STRING, type STRING, subjects STRING)
I20260316 18:56:01.859429 1046786 connection.cc:47] Query: CREATE NODE TABLE Community(id INT64 PRIMARY KEY, label STRING, acronym STRING, name STRING, type STRING, subjects STRING)
I20260316 18:56:01.859452 1046786 query_processor.cc:36] Executing plan with 52 threads, max_num_threads: 52
I20260316 18:56:01.859467 1046786 gopt_planner.cc:29] [GOptPlanner] compilePlan called with query: CREATE NODE TABLE Community(id INT64 PRIMARY KEY, label STRING, acronym STRING, name STRING, type STRING, subjects STRING)
I20260316 18:56:01.859993 1046786 pb_utils.cc:916] Setting string value: for type: StringView
I20260316 18:56:01.860020 1046786 pb_utils.cc:916] Setting string value: for type: StringView
I20260316 18:56:01.860029 1046786 pb_utils.cc:916] Setting string value: for type: StringView
I20260316 18:56:01.860039 1046786 pb_utils.cc:916] Setting string value: for type: StringView
I20260316 18:56:01.860050 1046786 pb_utils.cc:916] Setting string value: for type: StringView
I20260316 18:56:01.860313 1046786 property_graph.cc:236] CreateVertexType: vertex_type_name: Community, vertex_label_id: 1,properties 5, primary_key_names: id
I20260316 18:56:01.860378 1046786 query_processor.cc:144] Updating compiler meta if needed.
Created vertex table: Community (6 columns)
Creating Datasource node table
Query: CREATE NODE TABLE Datasource(id INT64 PRIMARY KEY, label STRING, type_value STRING, officialName STRING, subjects STRING)
I20260316 18:56:01.864625 1046786 connection.cc:47] Query: CREATE NODE TABLE Datasource(id INT64 PRIMARY KEY, label STRING, type_value STRING, officialName STRING, subjects STRING)
I20260316 18:56:01.864645 1046786 query_processor.cc:36] Executing plan with 52 threads, max_num_threads: 52
I20260316 18:56:01.864660 1046786 gopt_planner.cc:29] [GOptPlanner] compilePlan called with query: CREATE NODE TABLE Datasource(id INT64 PRIMARY KEY, label STRING, type_value STRING, officialName STRING, subjects STRING)
I20260316 18:56:01.865036 1046786 pb_utils.cc:916] Setting string value: for type: StringView
I20260316 18:56:01.865061 1046786 pb_utils.cc:916] Setting string value: for type: StringView
I20260316 18:56:01.865072 1046786 pb_utils.cc:916] Setting string value: for type: StringView
I20260316 18:56:01.865082 1046786 pb_utils.cc:916] Setting string value: for type: StringView
I20260316 18:56:01.865319 1046786 property_graph.cc:236] CreateVertexType: vertex_type_name: Datasource, vertex_label_id: 2,properties 4, primary_key_names: id
I20260316 18:56:01.865375 1046786 query_processor.cc:144] Updating compiler meta if needed.
Created vertex table: Datasource (5 columns)
Creating Funding node table
Query: CREATE NODE TABLE Funding(id INT64 PRIMARY KEY, label STRING, shortName STRING, name STRING, jurisdiction STRING)
I20260316 18:56:01.867914 1046786 connection.cc:47] Query: CREATE NODE TABLE Funding(id INT64 PRIMARY KEY, label STRING, shortName STRING, name STRING, jurisdiction STRING)
I20260316 18:56:01.867934 1046786 query_processor.cc:36] Executing plan with 52 threads, max_num_threads: 52
I20260316 18:56:01.867947 1046786 gopt_planner.cc:29] [GOptPlanner] compilePlan called with query: CREATE NODE TABLE Funding(id INT64 PRIMARY KEY, label STRING, shortName STRING, name STRING, jurisdiction STRING)
I20260316 18:56:01.868311 1046786 pb_utils.cc:916] Setting string value: for type: StringView
I20260316 18:56:01.868335 1046786 pb_utils.cc:916] Setting string value: for type: StringView
I20260316 18:56:01.868345 1046786 pb_utils.cc:916] Setting string value: for type: StringView
I20260316 18:56:01.868355 1046786 pb_utils.cc:916] Setting string value: for type: StringView
I20260316 18:56:01.868593 1046786 property_graph.cc:236] CreateVertexType: vertex_type_name: Funding, vertex_label_id: 3,properties 4, primary_key_names: id
I20260316 18:56:01.868649 1046786 query_processor.cc:144] Updating compiler meta if needed.
Created vertex table: Funding (5 columns)
Creating Organization node table
Query: CREATE NODE TABLE Organization(id INT64 PRIMARY KEY, label STRING, legalShortName STRING, legalName STRING, country_code STRING, country_label STRING)
I20260316 18:56:01.870667 1046786 connection.cc:47] Query: CREATE NODE TABLE Organization(id INT64 PRIMARY KEY, label STRING, legalShortName STRING, legalName STRING, country_code STRING, country_label STRING)
I20260316 18:56:01.870695 1046786 query_processor.cc:36] Executing plan with 52 threads, max_num_threads: 52
I20260316 18:56:01.870708 1046786 gopt_planner.cc:29] [GOptPlanner] compilePlan called with query: CREATE NODE TABLE Organization(id INT64 PRIMARY KEY, label STRING, legalShortName STRING, legalName STRING, country_code STRING, country_label STRING)
I20260316 18:56:01.871021 1046786 pb_utils.cc:916] Setting string value: for type: StringView
I20260316 18:56:01.871045 1046786 pb_utils.cc:916] Setting string value: for type: StringView
I20260316 18:56:01.871055 1046786 pb_utils.cc:916] Setting string value: for type: StringView
I20260316 18:56:01.871065 1046786 pb_utils.cc:916] Setting string value: for type: StringView
I20260316 18:56:01.871075 1046786 pb_utils.cc:916] Setting string value: for type: StringView
I20260316 18:56:01.871315 1046786 property_graph.cc:236] CreateVertexType: vertex_type_name: Organization, vertex_label_id: 4,properties 5, primary_key_names: id
I20260316 18:56:01.871367 1046786 query_processor.cc:144] Updating compiler meta if needed.
Created vertex table: Organization (6 columns)
Creating Project node table
Query: CREATE NODE TABLE Project(id INT64 PRIMARY KEY, label STRING, acronym STRING, title STRING, startDate STRING, endDate STRING, callIdentifier STRING)
I20260316 18:56:01.873848 1046786 connection.cc:47] Query: CREATE NODE TABLE Project(id INT64 PRIMARY KEY, label STRING, acronym STRING, title STRING, startDate STRING, endDate STRING, callIdentifier STRING)
I20260316 18:56:01.873867 1046786 query_processor.cc:36] Executing plan with 52 threads, max_num_threads: 52
I20260316 18:56:01.873879 1046786 gopt_planner.cc:29] [GOptPlanner] compilePlan called with query: CREATE NODE TABLE Project(id INT64 PRIMARY KEY, label STRING, acronym STRING, title STRING, startDate STRING, endDate STRING, callIdentifier STRING)
I20260316 18:56:01.874323 1046786 pb_utils.cc:916] Setting string value: for type: StringView
I20260316 18:56:01.874346 1046786 pb_utils.cc:916] Setting string value: for type: StringView
I20260316 18:56:01.874357 1046786 pb_utils.cc:916] Setting string value: for type: StringView
I20260316 18:56:01.874367 1046786 pb_utils.cc:916] Setting string value: for type: StringView
I20260316 18:56:01.874378 1046786 pb_utils.cc:916] Setting string value: for type: StringView
I20260316 18:56:01.874388 1046786 pb_utils.cc:916] Setting string value: for type: StringView
I20260316 18:56:01.874627 1046786 property_graph.cc:236] CreateVertexType: vertex_type_name: Project, vertex_label_id: 5,properties 6, primary_key_names: id
I20260316 18:56:01.874678 1046786 query_processor.cc:144] Updating compiler meta if needed.
Created vertex table: Project (7 columns)
Creating Publication node table
Query: CREATE NODE TABLE Publication(id INT64 PRIMARY KEY, label STRING, type STRING, originalIds STRING, mainTitle STRING, subTitle STRING, publicationDate STRING, year INT64, publisher STRING, FOS STRING, container_name STRING, countries STRING)
I20260316 18:56:01.877650 1046786 connection.cc:47] Query: CREATE NODE TABLE Publication(id INT64 PRIMARY KEY, label STRING, type STRING, originalIds STRING, mainTitle STRING, subTitle STRING, publicationDate STRING, year INT64, publisher STRING, FOS STRING, container_name STRING, countries STRING)
I20260316 18:56:01.877669 1046786 query_processor.cc:36] Executing plan with 52 threads, max_num_threads: 52
I20260316 18:56:01.877682 1046786 gopt_planner.cc:29] [GOptPlanner] compilePlan called with query: CREATE NODE TABLE Publication(id INT64 PRIMARY KEY, label STRING, type STRING, originalIds STRING, mainTitle STRING, subTitle STRING, publicationDate STRING, year INT64, publisher STRING, FOS STRING, container_name STRING, countries STRING)
I20260316 18:56:01.878224 1046786 pb_utils.cc:916] Setting string value: for type: StringView
I20260316 18:56:01.878248 1046786 pb_utils.cc:916] Setting string value: for type: StringView
I20260316 18:56:01.878259 1046786 pb_utils.cc:916] Setting string value: for type: StringView
I20260316 18:56:01.878269 1046786 pb_utils.cc:916] Setting string value: for type: StringView
I20260316 18:56:01.878279 1046786 pb_utils.cc:916] Setting string value: for type: StringView
I20260316 18:56:01.878288 1046786 pb_utils.cc:916] Setting string value: for type: StringView
I20260316 18:56:01.878298 1046786 pb_utils.cc:916] Setting string value: for type: StringView
I20260316 18:56:01.878309 1046786 pb_utils.cc:916] Setting string value: for type: StringView
I20260316 18:56:01.878319 1046786 pb_utils.cc:916] Setting string value: for type: StringView
I20260316 18:56:01.878329 1046786 pb_utils.cc:916] Setting string value: for type: StringView
I20260316 18:56:01.878674 1046786 property_graph.cc:236] CreateVertexType: vertex_type_name: Publication, vertex_label_id: 6,properties 11, primary_key_names: id
I20260316 18:56:01.878738 1046786 query_processor.cc:144] Updating compiler meta if needed.
Created vertex table: Publication (12 columns)
Creating author_authored_publication edge table
Query: CREATE REL TABLE author_authored_publication(FROM Author TO Publication)
I20260316 18:56:01.882779 1046786 connection.cc:47] Query: CREATE REL TABLE author_authored_publication(FROM Author TO Publication)
I20260316 18:56:01.882797 1046786 query_processor.cc:36] Executing plan with 52 threads, max_num_threads: 52
I20260316 18:56:01.882810 1046786 gopt_planner.cc:29] [GOptPlanner] compilePlan called with query: CREATE REL TABLE author_authored_publication(FROM Author TO Publication)
I20260316 18:56:01.883234 1046786 property_graph.cc:252] CreateEdgeType: src_vertex_type: Author, dst_vertex_type: Publication, edge_type_name: author_authored_publication
I20260316 18:56:01.883623 1046786 query_processor.cc:144] Updating compiler meta if needed.
Created edge table: author_authored_publication (FROM Author TO Publication, 2 columns)
Creating datasource_IsRelatedTo_community edge table
Query: CREATE REL TABLE datasource_IsRelatedTo_community(FROM Datasource TO Community)
I20260316 18:56:01.887303 1046786 connection.cc:47] Query: CREATE REL TABLE datasource_IsRelatedTo_community(FROM Datasource TO Community)
I20260316 18:56:01.887324 1046786 query_processor.cc:36] Executing plan with 52 threads, max_num_threads: 52
I20260316 18:56:01.887336 1046786 gopt_planner.cc:29] [GOptPlanner] compilePlan called with query: CREATE REL TABLE datasource_IsRelatedTo_community(FROM Datasource TO Community)
I20260316 18:56:01.887537 1046786 property_graph.cc:252] CreateEdgeType: src_vertex_type: Datasource, dst_vertex_type: Community, edge_type_name: datasource_IsRelatedTo_community
I20260316 18:56:01.887898 1046786 query_processor.cc:144] Updating compiler meta if needed.
Created edge table: datasource_IsRelatedTo_community (FROM Datasource TO Community, 2 columns)
Creating funding_for_project edge table
Query: CREATE REL TABLE funding_for_project(FROM Funding TO Project)
I20260316 18:56:01.891526 1046786 connection.cc:47] Query: CREATE REL TABLE funding_for_project(FROM Funding TO Project)
I20260316 18:56:01.891546 1046786 query_processor.cc:36] Executing plan with 52 threads, max_num_threads: 52
I20260316 18:56:01.891559 1046786 gopt_planner.cc:29] [GOptPlanner] compilePlan called with query: CREATE REL TABLE funding_for_project(FROM Funding TO Project)
I20260316 18:56:01.891722 1046786 property_graph.cc:252] CreateEdgeType: src_vertex_type: Funding, dst_vertex_type: Project, edge_type_name: funding_for_project
I20260316 18:56:01.892076 1046786 query_processor.cc:144] Updating compiler meta if needed.
Created edge table: funding_for_project (FROM Funding TO Project, 2 columns)
Creating organization_IsParentOf_organization edge table
Query: CREATE REL TABLE organization_IsParentOf_organization(FROM Organization TO Organization)
I20260316 18:56:01.895812 1046786 connection.cc:47] Query: CREATE REL TABLE organization_IsParentOf_organization(FROM Organization TO Organization)
I20260316 18:56:01.895831 1046786 query_processor.cc:36] Executing plan with 52 threads, max_num_threads: 52
I20260316 18:56:01.895844 1046786 gopt_planner.cc:29] [GOptPlanner] compilePlan called with query: CREATE REL TABLE organization_IsParentOf_organization(FROM Organization TO Organization)
I20260316 18:56:01.896019 1046786 property_graph.cc:252] CreateEdgeType: src_vertex_type: Organization, dst_vertex_type: Organization, edge_type_name: organization_IsParentOf_organization
I20260316 18:56:01.896354 1046786 query_processor.cc:144] Updating compiler meta if needed.
Created edge table: organization_IsParentOf_organization (FROM Organization TO Organization, 2 columns)
Creating organization_IsRelatedTo_community edge table
Query: CREATE REL TABLE organization_IsRelatedTo_community(FROM Organization TO Community)
I20260316 18:56:01.900139 1046786 connection.cc:47] Query: CREATE REL TABLE organization_IsRelatedTo_community(FROM Organization TO Community)
I20260316 18:56:01.900158 1046786 query_processor.cc:36] Executing plan with 52 threads, max_num_threads: 52
I20260316 18:56:01.900171 1046786 gopt_planner.cc:29] [GOptPlanner] compilePlan called with query: CREATE REL TABLE organization_IsRelatedTo_community(FROM Organization TO Community)
I20260316 18:56:01.900323 1046786 property_graph.cc:252] CreateEdgeType: src_vertex_type: Organization, dst_vertex_type: Community, edge_type_name: organization_IsRelatedTo_community
I20260316 18:56:01.900624 1046786 query_processor.cc:144] Updating compiler meta if needed.
Created edge table: organization_IsRelatedTo_community (FROM Organization TO Community, 2 columns)
Creating organization_provides_datasource edge table
Query: CREATE REL TABLE organization_provides_datasource(FROM Organization TO Datasource)
I20260316 18:56:01.904561 1046786 connection.cc:47] Query: CREATE REL TABLE organization_provides_datasource(FROM Organization TO Datasource)
I20260316 18:56:01.904582 1046786 query_processor.cc:36] Executing plan with 52 threads, max_num_threads: 52
I20260316 18:56:01.904593 1046786 gopt_planner.cc:29] [GOptPlanner] compilePlan called with query: CREATE REL TABLE organization_provides_datasource(FROM Organization TO Datasource)
I20260316 18:56:01.904753 1046786 property_graph.cc:252] CreateEdgeType: src_vertex_type: Organization, dst_vertex_type: Datasource, edge_type_name: organization_provides_datasource
I20260316 18:56:01.905051 1046786 query_processor.cc:144] Updating compiler meta if needed.
Created edge table: organization_provides_datasource (FROM Organization TO Datasource, 2 columns)
Creating project_hasParticipant_organization edge table
Query: CREATE REL TABLE project_hasParticipant_organization(FROM Project TO Organization)
I20260316 18:56:01.908722 1046786 connection.cc:47] Query: CREATE REL TABLE project_hasParticipant_organization(FROM Project TO Organization)
I20260316 18:56:01.908748 1046786 query_processor.cc:36] Executing plan with 52 threads, max_num_threads: 52
I20260316 18:56:01.908763 1046786 gopt_planner.cc:29] [GOptPlanner] compilePlan called with query: CREATE REL TABLE project_hasParticipant_organization(FROM Project TO Organization)
I20260316 18:56:01.908950 1046786 property_graph.cc:252] CreateEdgeType: src_vertex_type: Project, dst_vertex_type: Organization, edge_type_name: project_hasParticipant_organization
I20260316 18:56:01.909327 1046786 query_processor.cc:144] Updating compiler meta if needed.
Created edge table: project_hasParticipant_organization (FROM Project TO Organization, 2 columns)
Creating project_IsRelatedTo_community edge table
Query: CREATE REL TABLE project_IsRelatedTo_community(FROM Project TO Community)
I20260316 18:56:01.912995 1046786 connection.cc:47] Query: CREATE REL TABLE project_IsRelatedTo_community(FROM Project TO Community)
I20260316 18:56:01.913014 1046786 query_processor.cc:36] Executing plan with 52 threads, max_num_threads: 52
I20260316 18:56:01.913026 1046786 gopt_planner.cc:29] [GOptPlanner] compilePlan called with query: CREATE REL TABLE project_IsRelatedTo_community(FROM Project TO Community)
I20260316 18:56:01.913161 1046786 property_graph.cc:252] CreateEdgeType: src_vertex_type: Project, dst_vertex_type: Community, edge_type_name: project_IsRelatedTo_community
I20260316 18:56:01.913436 1046786 query_processor.cc:144] Updating compiler meta if needed.
Created edge table: project_IsRelatedTo_community (FROM Project TO Community, 2 columns)
Creating publication_hasAuthorInstitution_organization edge table
Query: CREATE REL TABLE publication_hasAuthorInstitution_organization(FROM Publication TO Organization)
I20260316 18:56:01.917344 1046786 connection.cc:47] Query: CREATE REL TABLE publication_hasAuthorInstitution_organization(FROM Publication TO Organization)
I20260316 18:56:01.917364 1046786 query_processor.cc:36] Executing plan with 52 threads, max_num_threads: 52
I20260316 18:56:01.917377 1046786 gopt_planner.cc:29] [GOptPlanner] compilePlan called with query: CREATE REL TABLE publication_hasAuthorInstitution_organization(FROM Publication TO Organization)
I20260316 18:56:01.917549 1046786 property_graph.cc:252] CreateEdgeType: src_vertex_type: Publication, dst_vertex_type: Organization, edge_type_name: publication_hasAuthorInstitution_organization
I20260316 18:56:01.917886 1046786 query_processor.cc:144] Updating compiler meta if needed.
Created edge table: publication_hasAuthorInstitution_organization (FROM Publication TO Organization, 2 columns)
Creating publication_isProducedBy_project edge table
Query: CREATE REL TABLE publication_isProducedBy_project(FROM Publication TO Project)
I20260316 18:56:01.922128 1046786 connection.cc:47] Query: CREATE REL TABLE publication_isProducedBy_project(FROM Publication TO Project)
I20260316 18:56:01.922147 1046786 query_processor.cc:36] Executing plan with 52 threads, max_num_threads: 52
I20260316 18:56:01.922159 1046786 gopt_planner.cc:29] [GOptPlanner] compilePlan called with query: CREATE REL TABLE publication_isProducedBy_project(FROM Publication TO Project)
I20260316 18:56:01.922326 1046786 property_graph.cc:252] CreateEdgeType: src_vertex_type: Publication, dst_vertex_type: Project, edge_type_name: publication_isProducedBy_project
I20260316 18:56:01.922684 1046786 query_processor.cc:144] Updating compiler meta if needed.
Created edge table: publication_isProducedBy_project (FROM Publication TO Project, 2 columns)
Creating publication_isProvidedBy_datasource edge table
Query: CREATE REL TABLE publication_isProvidedBy_datasource(FROM Publication TO Datasource)
I20260316 18:56:01.927057 1046786 connection.cc:47] Query: CREATE REL TABLE publication_isProvidedBy_datasource(FROM Publication TO Datasource)
I20260316 18:56:01.927076 1046786 query_processor.cc:36] Executing plan with 52 threads, max_num_threads: 52
I20260316 18:56:01.927088 1046786 gopt_planner.cc:29] [GOptPlanner] compilePlan called with query: CREATE REL TABLE publication_isProvidedBy_datasource(FROM Publication TO Datasource)
I20260316 18:56:01.927241 1046786 property_graph.cc:252] CreateEdgeType: src_vertex_type: Publication, dst_vertex_type: Datasource, edge_type_name: publication_isProvidedBy_datasource
I20260316 18:56:01.927533 1046786 query_processor.cc:144] Updating compiler meta if needed.
Created edge table: publication_isProvidedBy_datasource (FROM Publication TO Datasource, 2 columns)
Creating publication_IsRelatedTo_community edge table
Query: CREATE REL TABLE publication_IsRelatedTo_community(FROM Publication TO Community)
I20260316 18:56:01.931969 1046786 connection.cc:47] Query: CREATE REL TABLE publication_IsRelatedTo_community(FROM Publication TO Community)
I20260316 18:56:01.931989 1046786 query_processor.cc:36] Executing plan with 52 threads, max_num_threads: 52
I20260316 18:56:01.932001 1046786 gopt_planner.cc:29] [GOptPlanner] compilePlan called with query: CREATE REL TABLE publication_IsRelatedTo_community(FROM Publication TO Community)
I20260316 18:56:01.932149 1046786 property_graph.cc:252] CreateEdgeType: src_vertex_type: Publication, dst_vertex_type: Community, edge_type_name: publication_IsRelatedTo_community
I20260316 18:56:01.932447 1046786 query_processor.cc:144] Updating compiler meta if needed.
Created edge table: publication_IsRelatedTo_community (FROM Publication TO Community, 2 columns)
Schema created successfully!
Vertex labels: 7
Edge labels: 12
=== Loading Data from CSV Files ===
Loading vertex data...
Loading Author nodes
Query: COPY Author FROM '/mnt/lyk/openaire_scripts/output//author.csv' (HEADER=true, DELIMITER=',')
I20260316 18:56:01.937288 1046786 connection.cc:47] Query: COPY Author FROM '/mnt/lyk/openaire_scripts/output//author.csv' (HEADER=true, DELIMITER=',')
I20260316 18:56:01.937309 1046786 query_processor.cc:36] Executing plan with 52 threads, max_num_threads: 52
I20260316 18:56:01.937321 1046786 gopt_planner.cc:29] [GOptPlanner] compilePlan called with query: COPY Author FROM '/mnt/lyk/openaire_scripts/output//author.csv' (HEADER=true, DELIMITER=',')
I20260316 18:56:01.952749 1046786 batch_insert_vertex.cc:86] vertex_label_id: 0
I20260316 18:56:01.965345 1046786 batch_update_utils.cc:372] column mappings size: 9
I20260316 18:56:03.371730 1046786 query_processor.cc:144] Updating compiler meta if needed.
Loading Community nodes
Query: COPY Community FROM '/mnt/lyk/openaire_scripts/output//community.csv' (HEADER=true, DELIMITER=',')
I20260316 18:56:03.372525 1046786 connection.cc:47] Query: COPY Community FROM '/mnt/lyk/openaire_scripts/output//community.csv' (HEADER=true, DELIMITER=',')
I20260316 18:56:03.372543 1046786 query_processor.cc:36] Executing plan with 52 threads, max_num_threads: 52
I20260316 18:56:03.372553 1046786 gopt_planner.cc:29] [GOptPlanner] compilePlan called with query: COPY Community FROM '/mnt/lyk/openaire_scripts/output//community.csv' (HEADER=true, DELIMITER=',')
I20260316 18:56:03.374998 1046786 batch_insert_vertex.cc:86] vertex_label_id: 1
I20260316 18:56:03.375918 1046786 batch_update_utils.cc:372] column mappings size: 6
I20260316 18:56:03.376487 1046786 query_processor.cc:144] Updating compiler meta if needed.
Loading Datasource nodes
Query: COPY Datasource FROM '/mnt/lyk/openaire_scripts/output//datasource.csv' (HEADER=true, DELIMITER=',')
I20260316 18:56:03.377174 1046786 connection.cc:47] Query: COPY Datasource FROM '/mnt/lyk/openaire_scripts/output//datasource.csv' (HEADER=true, DELIMITER=',')
I20260316 18:56:03.377188 1046786 query_processor.cc:36] Executing plan with 52 threads, max_num_threads: 52
I20260316 18:56:03.377197 1046786 gopt_planner.cc:29] [GOptPlanner] compilePlan called with query: COPY Datasource FROM '/mnt/lyk/openaire_scripts/output//datasource.csv' (HEADER=true, DELIMITER=',')
I20260316 18:56:03.727145 1046786 batch_insert_vertex.cc:86] vertex_label_id: 2
I20260316 18:56:03.778030 1046786 batch_update_utils.cc:372] column mappings size: 5
I20260316 18:56:04.202841 1046786 query_processor.cc:144] Updating compiler meta if needed.
Loading Funding nodes
Query: COPY Funding FROM '/mnt/lyk/openaire_scripts/output//funding.csv' (HEADER=true, DELIMITER=',')
I20260316 18:56:04.203682 1046786 connection.cc:47] Query: COPY Funding FROM '/mnt/lyk/openaire_scripts/output//funding.csv' (HEADER=true, DELIMITER=',')
I20260316 18:56:04.203702 1046786 query_processor.cc:36] Executing plan with 52 threads, max_num_threads: 52
I20260316 18:56:04.203712 1046786 gopt_planner.cc:29] [GOptPlanner] compilePlan called with query: COPY Funding FROM '/mnt/lyk/openaire_scripts/output//funding.csv' (HEADER=true, DELIMITER=',')
I20260316 18:56:04.205183 1046786 batch_insert_vertex.cc:86] vertex_label_id: 3
I20260316 18:56:04.206015 1046786 batch_update_utils.cc:372] column mappings size: 5
I20260316 18:56:04.206499 1046786 query_processor.cc:144] Updating compiler meta if needed.
Loading Organization nodes
Query: COPY Organization FROM '/mnt/lyk/openaire_scripts/output//organization.csv' (HEADER=true, DELIMITER=',')
I20260316 18:56:04.207262 1046786 connection.cc:47] Query: COPY Organization FROM '/mnt/lyk/openaire_scripts/output//organization.csv' (HEADER=true, DELIMITER=',')
I20260316 18:56:04.207278 1046786 query_processor.cc:36] Executing plan with 52 threads, max_num_threads: 52
I20260316 18:56:04.207293 1046786 gopt_planner.cc:29] [GOptPlanner] compilePlan called with query: COPY Organization FROM '/mnt/lyk/openaire_scripts/output//organization.csv' (HEADER=true, DELIMITER=',')
I20260316 18:56:04.306756 1046786 batch_insert_vertex.cc:86] vertex_label_id: 4
I20260316 18:56:04.331672 1046786 batch_update_utils.cc:372] column mappings size: 6
I20260316 18:56:05.262007 1046786 query_processor.cc:144] Updating compiler meta if needed.
Loading Project nodes
Query: COPY Project FROM '/mnt/lyk/openaire_scripts/output//project.csv' (HEADER=true, DELIMITER=',')
I20260316 18:56:05.263228 1046786 connection.cc:47] Query: COPY Project FROM '/mnt/lyk/openaire_scripts/output//project.csv' (HEADER=true, DELIMITER=',')
I20260316 18:56:05.263249 1046786 query_processor.cc:36] Executing plan with 52 threads, max_num_threads: 52
I20260316 18:56:05.263259 1046786 gopt_planner.cc:29] [GOptPlanner] compilePlan called with query: COPY Project FROM '/mnt/lyk/openaire_scripts/output//project.csv' (HEADER=true, DELIMITER=',')
I20260316 18:56:05.336705 1046786 batch_insert_vertex.cc:86] vertex_label_id: 5
I20260316 18:56:05.361614 1046786 batch_update_utils.cc:372] column mappings size: 7
I20260316 18:56:16.584009 1046786 query_processor.cc:144] Updating compiler meta if needed.
Loading Publication nodes
Query: COPY Publication FROM '/mnt/lyk/openaire_scripts/output//publication.csv' (HEADER=true, DELIMITER=',')
I20260316 18:56:16.588248 1046786 connection.cc:47] Query: COPY Publication FROM '/mnt/lyk/openaire_scripts/output//publication.csv' (HEADER=true, DELIMITER=',')
I20260316 18:56:16.588274 1046786 query_processor.cc:36] Executing plan with 52 threads, max_num_threads: 52
I20260316 18:56:16.588284 1046786 gopt_planner.cc:29] [GOptPlanner] compilePlan called with query: COPY Publication FROM '/mnt/lyk/openaire_scripts/output//publication.csv' (HEADER=true, DELIMITER=',')
I20260316 18:56:16.666293 1046786 batch_insert_vertex.cc:86] vertex_label_id: 6
I20260316 18:56:16.672977 1046786 batch_update_utils.cc:372] column mappings size: 12
I20260316 19:01:25.001356 1046786 query_processor.cc:144] Updating compiler meta if needed.
Loading edge data...
Loading author_authored_publication edges
Query: COPY author_authored_publication FROM '/mnt/lyk/openaire_scripts/output//author_authored_publication.csv' (HEADER=true, DELIMITER=',')
I20260316 19:01:25.021854 1046786 connection.cc:47] Query: COPY author_authored_publication FROM '/mnt/lyk/openaire_scripts/output//author_authored_publication.csv' (HEADER=true, DELIMITER=',')
I20260316 19:01:25.021886 1046786 query_processor.cc:36] Executing plan with 52 threads, max_num_threads: 52
I20260316 19:01:25.021899 1046786 gopt_planner.cc:29] [GOptPlanner] compilePlan called with query: COPY author_authored_publication FROM '/mnt/lyk/openaire_scripts/output//author_authored_publication.csv' (HEADER=true, DELIMITER=',')
I20260316 19:01:26.988682 1046786 batch_update_utils.cc:372] column mappings size: 2
I20260316 19:01:29.692287 1046786 query_processor.cc:144] Updating compiler meta if needed.
Loading datasource_IsRelatedTo_community edges
Query: COPY datasource_IsRelatedTo_community FROM '/mnt/lyk/openaire_scripts/output//datasource_IsRelatedTo_community.csv' (HEADER=true, DELIMITER=',')
I20260316 19:01:29.723702 1046786 connection.cc:47] Query: COPY datasource_IsRelatedTo_community FROM '/mnt/lyk/openaire_scripts/output//datasource_IsRelatedTo_community.csv' (HEADER=true, DELIMITER=',')
I20260316 19:01:29.723731 1046786 query_processor.cc:36] Executing plan with 52 threads, max_num_threads: 52
I20260316 19:01:29.723742 1046786 gopt_planner.cc:29] [GOptPlanner] compilePlan called with query: COPY datasource_IsRelatedTo_community FROM '/mnt/lyk/openaire_scripts/output//datasource_IsRelatedTo_community.csv' (HEADER=true, DELIMITER=',')
I20260316 19:01:30.579499 1046786 batch_update_utils.cc:372] column mappings size: 2
I20260316 19:01:30.584681 1046786 query_processor.cc:144] Updating compiler meta if needed.
Loading funding_for_project edges
Query: COPY funding_for_project FROM '/mnt/lyk/openaire_scripts/output//funding_for_project.csv' (HEADER=true, DELIMITER=',')
I20260316 19:01:30.616638 1046786 connection.cc:47] Query: COPY funding_for_project FROM '/mnt/lyk/openaire_scripts/output//funding_for_project.csv' (HEADER=true, DELIMITER=',')
I20260316 19:01:30.616672 1046786 query_processor.cc:36] Executing plan with 52 threads, max_num_threads: 52
I20260316 19:01:30.616683 1046786 gopt_planner.cc:29] [GOptPlanner] compilePlan called with query: COPY funding_for_project FROM '/mnt/lyk/openaire_scripts/output//funding_for_project.csv' (HEADER=true, DELIMITER=',')
I20260316 19:01:30.818053 1046786 batch_update_utils.cc:372] column mappings size: 2
I20260316 19:01:31.673288 1046786 query_processor.cc:144] Updating compiler meta if needed.
Loading organization_IsParentOf_organization edges
Query: COPY organization_IsParentOf_organization FROM '/mnt/lyk/openaire_scripts/output//organization_IsParentOf_organization.csv' (HEADER=true, DELIMITER=',')
I20260316 19:01:31.710629 1046786 connection.cc:47] Query: COPY organization_IsParentOf_organization FROM '/mnt/lyk/openaire_scripts/output//organization_IsParentOf_organization.csv' (HEADER=true, DELIMITER=',')
I20260316 19:01:31.710657 1046786 query_processor.cc:36] Executing plan with 52 threads, max_num_threads: 52
I20260316 19:01:31.710668 1046786 gopt_planner.cc:29] [GOptPlanner] compilePlan called with query: COPY organization_IsParentOf_organization FROM '/mnt/lyk/openaire_scripts/output//organization_IsParentOf_organization.csv' (HEADER=true, DELIMITER=',')
I20260316 19:01:32.565496 1046786 batch_update_utils.cc:372] column mappings size: 2
I20260316 19:01:32.596191 1046786 query_processor.cc:144] Updating compiler meta if needed.
Loading organization_IsRelatedTo_community edges
Query: COPY organization_IsRelatedTo_community FROM '/mnt/lyk/openaire_scripts/output//organization_IsRelatedTo_community.csv' (HEADER=true, DELIMITER=',')
I20260316 19:01:32.634847 1046786 connection.cc:47] Query: COPY organization_IsRelatedTo_community FROM '/mnt/lyk/openaire_scripts/output//organization_IsRelatedTo_community.csv' (HEADER=true, DELIMITER=',')
I20260316 19:01:32.634886 1046786 query_processor.cc:36] Executing plan with 52 threads, max_num_threads: 52
I20260316 19:01:32.634895 1046786 gopt_planner.cc:29] [GOptPlanner] compilePlan called with query: COPY organization_IsRelatedTo_community FROM '/mnt/lyk/openaire_scripts/output//organization_IsRelatedTo_community.csv' (HEADER=true, DELIMITER=',')
I20260316 19:01:32.636591 1046786 batch_update_utils.cc:372] column mappings size: 2
I20260316 19:01:32.651579 1046786 query_processor.cc:144] Updating compiler meta if needed.
Loading organization_provides_datasource edges
Query: COPY organization_provides_datasource FROM '/mnt/lyk/openaire_scripts/output//organization_provides_datasource.csv' (HEADER=true, DELIMITER=',')
I20260316 19:01:32.690982 1046786 connection.cc:47] Query: COPY organization_provides_datasource FROM '/mnt/lyk/openaire_scripts/output//organization_provides_datasource.csv' (HEADER=true, DELIMITER=',')
I20260316 19:01:32.691016 1046786 query_processor.cc:36] Executing plan with 52 threads, max_num_threads: 52
I20260316 19:01:32.691026 1046786 gopt_planner.cc:29] [GOptPlanner] compilePlan called with query: COPY organization_provides_datasource FROM '/mnt/lyk/openaire_scripts/output//organization_provides_datasource.csv' (HEADER=true, DELIMITER=',')
I20260316 19:01:33.368548 1046786 batch_update_utils.cc:372] column mappings size: 2
I20260316 19:01:33.397380 1046786 query_processor.cc:144] Updating compiler meta if needed.
Loading project_hasParticipant_organization edges
Query: COPY project_hasParticipant_organization FROM '/mnt/lyk/openaire_scripts/output//project_hasParticipant_organization.csv' (HEADER=true, DELIMITER=',')
I20260316 19:01:33.437515 1046786 connection.cc:47] Query: COPY project_hasParticipant_organization FROM '/mnt/lyk/openaire_scripts/output//project_hasParticipant_organization.csv' (HEADER=true, DELIMITER=',')
I20260316 19:01:33.437552 1046786 query_processor.cc:36] Executing plan with 52 threads, max_num_threads: 52
I20260316 19:01:33.437562 1046786 gopt_planner.cc:29] [GOptPlanner] compilePlan called with query: COPY project_hasParticipant_organization FROM '/mnt/lyk/openaire_scripts/output//project_hasParticipant_organization.csv' (HEADER=true, DELIMITER=',')
I20260316 19:01:35.487728 1046786 batch_update_utils.cc:372] column mappings size: 2
I20260316 19:01:37.426401 1046786 query_processor.cc:144] Updating compiler meta if needed.
Loading project_IsRelatedTo_community edges
Query: COPY project_IsRelatedTo_community FROM '/mnt/lyk/openaire_scripts/output//project_IsRelatedTo_community.csv' (HEADER=true, DELIMITER=',')
I20260316 19:01:37.490505 1046786 connection.cc:47] Query: COPY project_IsRelatedTo_community FROM '/mnt/lyk/openaire_scripts/output//project_IsRelatedTo_community.csv' (HEADER=true, DELIMITER=',')
I20260316 19:01:37.490535 1046786 query_processor.cc:36] Executing plan with 52 threads, max_num_threads: 52
I20260316 19:01:37.490545 1046786 gopt_planner.cc:29] [GOptPlanner] compilePlan called with query: COPY project_IsRelatedTo_community FROM '/mnt/lyk/openaire_scripts/output//project_IsRelatedTo_community.csv' (HEADER=true, DELIMITER=',')
I20260316 19:01:37.697542 1046786 batch_update_utils.cc:372] column mappings size: 2
I20260316 19:01:37.830919 1046786 query_processor.cc:144] Updating compiler meta if needed.
Loading publication_hasAuthorInstitution_organization edges
Query: COPY publication_hasAuthorInstitution_organization FROM '/mnt/lyk/openaire_scripts/output//publication_hasAuthorInstitution_organization.csv' (HEADER=true, DELIMITER=',')
I20260316 19:01:37.902359 1046786 connection.cc:47] Query: COPY publication_hasAuthorInstitution_organization FROM '/mnt/lyk/openaire_scripts/output//publication_hasAuthorInstitution_organization.csv' (HEADER=true, DELIMITER=',')
I20260316 19:01:37.902398 1046786 query_processor.cc:36] Executing plan with 52 threads, max_num_threads: 52
I20260316 19:01:37.902410 1046786 gopt_planner.cc:29] [GOptPlanner] compilePlan called with query: COPY publication_hasAuthorInstitution_organization FROM '/mnt/lyk/openaire_scripts/output//publication_hasAuthorInstitution_organization.csv' (HEADER=true, DELIMITER=',')
I20260316 19:01:39.328253 1046786 batch_update_utils.cc:372] column mappings size: 2
I20260316 19:02:28.625152 1046786 query_processor.cc:144] Updating compiler meta if needed.
Loading publication_isProducedBy_project edges
Query: COPY publication_isProducedBy_project FROM '/mnt/lyk/openaire_scripts/output//publication_isProducedBy_project.csv' (HEADER=true, DELIMITER=',')
I20260316 19:02:28.934216 1046786 connection.cc:47] Query: COPY publication_isProducedBy_project FROM '/mnt/lyk/openaire_scripts/output//publication_isProducedBy_project.csv' (HEADER=true, DELIMITER=',')
I20260316 19:02:28.934242 1046786 query_processor.cc:36] Executing plan with 52 threads, max_num_threads: 52
I20260316 19:02:28.934254 1046786 gopt_planner.cc:29] [GOptPlanner] compilePlan called with query: COPY publication_isProducedBy_project FROM '/mnt/lyk/openaire_scripts/output//publication_isProducedBy_project.csv' (HEADER=true, DELIMITER=',')
I20260316 19:02:29.660106 1046786 batch_update_utils.cc:372] column mappings size: 2
I20260316 19:02:32.417672 1046786 query_processor.cc:144] Updating compiler meta if needed.
Loading publication_isProvidedBy_datasource edges
Query: COPY publication_isProvidedBy_datasource FROM '/mnt/lyk/openaire_scripts/output//publication_isProvidedBy_datasource.csv' (HEADER=true, DELIMITER=',')
I20260316 19:02:32.775338 1046786 connection.cc:47] Query: COPY publication_isProvidedBy_datasource FROM '/mnt/lyk/openaire_scripts/output//publication_isProvidedBy_datasource.csv' (HEADER=true, DELIMITER=',')
I20260316 19:02:32.775368 1046786 query_processor.cc:36] Executing plan with 52 threads, max_num_threads: 52
I20260316 19:02:32.775380 1046786 gopt_planner.cc:29] [GOptPlanner] compilePlan called with query: COPY publication_isProvidedBy_datasource FROM '/mnt/lyk/openaire_scripts/output//publication_isProvidedBy_datasource.csv' (HEADER=true, DELIMITER=',')
I20260316 19:02:33.876626 1046786 batch_update_utils.cc:372] column mappings size: 2
I20260316 19:02:54.707949 1046786 query_processor.cc:144] Updating compiler meta if needed.
Loading publication_IsRelatedTo_community edges
Query: COPY publication_IsRelatedTo_community FROM '/mnt/lyk/openaire_scripts/output//publication_IsRelatedTo_community.csv' (HEADER=true, DELIMITER=',')
I20260316 19:02:55.308895 1046786 connection.cc:47] Query: COPY publication_IsRelatedTo_community FROM '/mnt/lyk/openaire_scripts/output//publication_IsRelatedTo_community.csv' (HEADER=true, DELIMITER=',')
I20260316 19:02:55.308928 1046786 query_processor.cc:36] Executing plan with 52 threads, max_num_threads: 52
I20260316 19:02:55.308939 1046786 gopt_planner.cc:29] [GOptPlanner] compilePlan called with query: COPY publication_IsRelatedTo_community FROM '/mnt/lyk/openaire_scripts/output//publication_IsRelatedTo_community.csv' (HEADER=true, DELIMITER=',')
I20260316 19:02:55.410380 1046786 batch_update_utils.cc:372] column mappings size: 2
I20260316 19:02:59.642378 1046786 query_processor.cc:144] Updating compiler meta if needed.
Data loaded successfully in 418s!
When importing the same dataset with Neo4j, it costs 2m44s:
[2026-03-16 09:35:54] =============================================
[2026-03-16 09:35:54] Neo4j OpenAIRE Data Import
[2026-03-16 09:35:54] =============================================
[2026-03-16 09:35:54] Data directory : /var/lib/neo4j/import/output_neo4j
[2026-03-16 09:35:54] Target database: openaire
[2026-03-16 09:35:54] NEO4J_HOME : /var/lib/neo4j
[2026-03-16 09:35:54]
[2026-03-16 09:35:54] Neo4j is not running, proceeding.
[2026-03-16 09:35:54] Ensuring data directory structure...
[2026-03-16 09:35:54] Running as root, fixing ownership for neo4j user...
[2026-03-16 09:35:54] Import started at 2026-03-16 09:35:54
[2026-03-16 09:35:54]
Executing command line: /opt/java/openjdk/bin/java -cp /var/lib/neo4j/plugins/:/var/lib/neo4j/conf/:/var/lib/neo4j/lib/* -XX:+UseParallelGC -XX:-OmitStackTraceInFastThrow -XX:+UnlockExperimentalVMOptions -XX:+TrustFinalNonStaticFields -XX:+DisableExplicitGC -Djdk.nio.maxCachedBufferSize=1024 -Dio.netty.tryReflectionSetAccessible=true -Dio.netty.leakDetection.level=DISABLED -XX:+ExitOnOutOfMemoryError -Djdk.tls.ephemeralDHKeySize=2048 -XX:FlightRecorderOptions=stackdepth=256 -XX:+UnlockDiagnosticVMOptions -XX:+DebugNonSafepoints --add-opens=java.base/java.nio=ALL-UNNAMED --add-opens=java.base/java.io=ALL-UNNAMED --add-opens=java.base/sun.nio.ch=ALL-UNNAMED --add-opens=java.base/java.util.concurrent=ALL-UNNAMED --enable-native-access=ALL-UNNAMED -Dlog4j2.disable.jmx=true -Dfile.encoding=UTF-8 org.neo4j.cli.AdminTool database import full --overwrite-destination=true --skip-bad-relationships=true --skip-duplicate-nodes=true --multiline-fields=true --trim-strings=true --verbose --nodes=Author=/var/lib/neo4j/import/output_neo4j/author.csv --nodes=Community=/var/lib/neo4j/import/output_neo4j/community.csv --nodes=Datasource=/var/lib/neo4j/import/output_neo4j/datasource.csv --nodes=Funding=/var/lib/neo4j/import/output_neo4j/funding.csv --nodes=Organization=/var/lib/neo4j/import/output_neo4j/organization.csv --nodes=Project=/var/lib/neo4j/import/output_neo4j/project.csv --nodes=Publication=/var/lib/neo4j/import/output_neo4j/publication.csv --relationships=AUTHORED=/var/lib/neo4j/import/output_neo4j/author_authored_publication.csv --relationships=IS_RELATED_TO=/var/lib/neo4j/import/output_neo4j/datasource_IsRelatedTo_community.csv --relationships=FUNDS=/var/lib/neo4j/import/output_neo4j/funding_for_project.csv --relationships=IS_PARENT_OF=/var/lib/neo4j/import/output_neo4j/organization_IsParentOf_organization.csv --relationships=IS_RELATED_TO=/var/lib/neo4j/import/output_neo4j/organization_IsRelatedTo_community.csv --relationships=PROVIDES=/var/lib/neo4j/import/output_neo4j/organization_provides_datasource.csv --relationships=HAS_PARTICIPANT=/var/lib/neo4j/import/output_neo4j/project_hasParticipant_organization.csv --relationships=IS_RELATED_TO=/var/lib/neo4j/import/output_neo4j/project_IsRelatedTo_community.csv --relationships=HAS_AUTHOR_INSTITUTION=/var/lib/neo4j/import/output_neo4j/publication_hasAuthorInstitution_organization.csv --relationships=IS_PRODUCED_BY=/var/lib/neo4j/import/output_neo4j/publication_isProducedBy_project.csv --relationships=IS_PROVIDED_BY=/var/lib/neo4j/import/output_neo4j/publication_isProvidedBy_datasource.csv --relationships=IS_RELATED_TO=/var/lib/neo4j/import/output_neo4j/publication_IsRelatedTo_community.csv -- openaire
neo4j 2025.11.2
VM Name: OpenJDK 64-Bit Server VM
VM Vendor: Eclipse Adoptium
VM Version: 21.0.9+10-LTS
JIT compiler: HotSpot 64-Bit Tiered Compilers
VM Arguments: [-XX:+UseParallelGC, -XX:-OmitStackTraceInFastThrow, -XX:+UnlockExperimentalVMOptions, -XX:+TrustFinalNonStaticFields, -XX:+DisableExplicitGC, -Djdk.nio.maxCachedBufferSize=1024, -Dio.netty.tryReflectionSetAccessible=true, -Dio.netty.leakDetection.level=DISABLED, -XX:+ExitOnOutOfMemoryError, -Djdk.tls.ephemeralDHKeySize=2048, -XX:FlightRecorderOptions=stackdepth=256, -XX:+UnlockDiagnosticVMOptions, -XX:+DebugNonSafepoints, --add-opens=java.base/java.nio=ALL-UNNAMED, --add-opens=java.base/java.io=ALL-UNNAMED, --add-opens=java.base/sun.nio.ch=ALL-UNNAMED, --add-opens=java.base/java.util.concurrent=ALL-UNNAMED, --enable-native-access=ALL-UNNAMED, -Dlog4j2.disable.jmx=true, -Dfile.encoding=UTF-8]
Configuration files used (ordered by priority):
/var/lib/neo4j/conf/neo4j-admin.conf
/var/lib/neo4j/conf/neo4j.conf
Starting to import, output will be saved to: /logs/neo4j-admin-import-2026-03-16.09.35.56.log
Neo4j version: 2025.11.2
Importing the contents of these files into /data/databases/openaire:
Nodes:
[Datasource]:
/var/lib/neo4j/import/output_neo4j/datasource.csv
[Project]:
/var/lib/neo4j/import/output_neo4j/project.csv
[Organization]:
/var/lib/neo4j/import/output_neo4j/organization.csv
[Funding]:
/var/lib/neo4j/import/output_neo4j/funding.csv
[Publication]:
/var/lib/neo4j/import/output_neo4j/publication.csv
[Author]:
/var/lib/neo4j/import/output_neo4j/author.csv
[Community]:
/var/lib/neo4j/import/output_neo4j/community.csv
Relationships:
HAS_PARTICIPANT:
/var/lib/neo4j/import/output_neo4j/project_hasParticipant_organization.csv
HAS_AUTHOR_INSTITUTION:
/var/lib/neo4j/import/output_neo4j/publication_hasAuthorInstitution_organization.csv
IS_PRODUCED_BY:
/var/lib/neo4j/import/output_neo4j/publication_isProducedBy_project.csv
IS_PARENT_OF:
/var/lib/neo4j/import/output_neo4j/organization_IsParentOf_organization.csv
IS_PROVIDED_BY:
/var/lib/neo4j/import/output_neo4j/publication_isProvidedBy_datasource.csv
IS_RELATED_TO:
/var/lib/neo4j/import/output_neo4j/datasource_IsRelatedTo_community.csv
/var/lib/neo4j/import/output_neo4j/organization_IsRelatedTo_community.csv
/var/lib/neo4j/import/output_neo4j/project_IsRelatedTo_community.csv
/var/lib/neo4j/import/output_neo4j/publication_IsRelatedTo_community.csv
AUTHORED:
/var/lib/neo4j/import/output_neo4j/author_authored_publication.csv
PROVIDES:
/var/lib/neo4j/import/output_neo4j/organization_provides_datasource.csv
FUNDS:
/var/lib/neo4j/import/output_neo4j/funding_for_project.csv
Available resources:
Total machine memory: 751.1GiB
Free machine memory: 7.547GiB
Max heap memory : 26.67GiB
Max worker threads: 52
Configured max memory: 3.513GiB
High parallel IO: true
Cypher type normalization is enabled (disable with --normalize-types=false):
Property type of 'year' normalized from 'int' --> 'long' in /var/lib/neo4j/import/output_neo4j/publication.csv
Nodes, started 2026-03-16 09:36:00.360+0000
[Nodes:0B/s 682.0MiB-------------------------------------------------------------------------]22.3M ∆ 420K
Done in 1m 10s 942ms
Prepare node index, started 2026-03-16 09:37:20.649+0000
[:767.4MiB-----------------------------------------------------------------------------------]67.1M ∆36.9M
Done in 2s 873ms
Relationships, started 2026-03-16 09:37:23.526+0000
[*Relationships:0B/s 767.4MiB-----------------------------------------------------------------]94.4M ∆2.11M
Done in 30s 741ms
Node Degrees, started 2026-03-16 09:37:54.305+0000
[>------------------------------------|*CALCULATE:723.5MiB(22)================================]94.4M ∆10.2M
Done in 10s 951ms
Relationship --> Relationship 1-9/9, started 2026-03-16 09:38:05.480+0000
[>(5)==================|LINK(17)=============================================|v:235.5MiB/s(4)]94.4M ∆12.1M
Done in 13s 368ms
RelationshipGroup 1-9/9, started 2026-03-16 09:38:18.852+0000
[>-----------------------------------------------------------------------------------------|v]22.3M ∆22.3M
Done in 500ms
Node --> Relationship, started 2026-03-16 09:38:19.357+0000
[>:170.8MiB/s-------------|>(5)=======|LINK---------|*v:314.5MiB/s----------------------------]22.1M ∆22.1M
Done in 1s 708ms
Relationship <-- Relationship 1-9/9, started 2026-03-16 09:38:21.081+0000
[>(5)=================|LINK(19)============================================|v:306.1MiB/s(4)==]94.4M ∆22.5M
Done in 10s 675ms
Count groups, started 2026-03-16 09:38:31.783+0000
[>|>---------------------------------------------------------|COUNT:552.7MiB-----------------] 152K ∆ 152K
Done in 53ms
Gather, started 2026-03-16 09:38:32.152+0000
[>---------------------|CACHE:745.7MiB-------------------------------------------------------] 152K ∆ 152K
Done in 53ms
Write, started 2026-03-16 09:38:32.208+0000
[>:??---------------------------------------------------------------------------------|E|v:??] 151K ∆ 151K
Done in 180ms
Node --> Group, started 2026-03-16 09:38:32.401+0000
[>-----|*FIRST---------------------------------------------------------------------|v:??------]72.0K ∆72.0K
Done in 197ms
Node counts and label index build, started 2026-03-16 09:38:33.315+0000
[>(5)======================|*LABEL INDEX-------------------------|COUNT:680.8MiB--------------]22.3M ∆8.25M
Done in 1s 418ms
Relationship counts and relationship type index build, started 2026-03-16 09:38:34.960+0000
[>(5)================|*RELATIONSHIP TYPE INDEX--------------------------------|COUNT(9)=======]94.4M ∆36.7M
Done in 5s 817ms
IMPORT DONE in 2m 44s 290ms.
Imported:
22368040 nodes
94401386 relationships
198310776 properties
Peak memory usage: 767.4MiB
cpu:
Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Byte Order: Little Endian
Address sizes: 46 bits physical, 48 bits virtual
CPU(s): 52
On-line CPU(s) list: 0-51
Vendor ID: GenuineIntel
CPU family: 6
Model: 85
Model name: Intel(R) Xeon(R) Platinum 8269CY CPU @ 2.50GHz
Metadata
Metadata
Assignees
Type
Projects
Status