Skip to content

[WIP] Optionally Generate SPARK_HOME system-scope deps for build instead of using Maven repos #12775

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Draft
gerashegalov wants to merge 5 commits into
base: main
Choose a base branch
from
Draft

[WIP] Optionally Generate SPARK_HOME system-scope deps for build instead of using Maven repos #12775

gerashegalov wants to merge 5 commits into from

Conversation

@gerashegalov
Copy link
Collaborator

@gerashegalov gerashegalov commented May 23, 2025 •
edited
Loading

Closes #12820

@gerashegalov
Generate DB deps on the fly
e1198e3 
Signed-off-by: Gera Shegalov <gshegalov@nvidia.com>
@gerashegalov
Fix comment in template
9b30f2d 
Signed-off-by: Gera Shegalov <gshegalov@nvidia.com>
@gerashegalov
scala2.13 sync
0413d42 
Signed-off-by: Gera Shegalov <gshegalov@nvidia.com>
@gerashegalov
Add profile to tools
f88340e 
Signed-off-by: Gera Shegalov <gshegalov@nvidia.com>
@gerashegalov gerashegalov self-assigned this May 23, 2025
@gerashegalov
Delete all install_deps.py
6ab60df 
Signed-off-by: Gera Shegalov <gshegalov@nvidia.com>
@gerashegalov
Copy link
Collaborator Author

gerashegalov commented May 23, 2025

build

@gerashegalov gerashegalov requested a review from razajafri May 27, 2025 18:31
@gerashegalov gerashegalov mentioned this pull request May 30, 2025
Open
@gerashegalov gerashegalov changed the title [WIP] Generate [databricks] system deps for build [WIP] Optionally Generate SPARK_HOME system-scope deps for build May 30, 2025
@gerashegalov gerashegalov added the build Related to CI / CD or cleanly building label May 30, 2025
@gerashegalov gerashegalov changed the title [WIP] Optionally Generate SPARK_HOME system-scope deps for build [WIP] Optionally Generate SPARK_HOME system-scope deps for build instead of using Maven repos May 30, 2025
@gerashegalov gerashegalov changed the base branch from branch-25.06 to branch-25.08 June 2, 2025 23:31
@gerashegalov gerashegalov changed the base branch from branch-25.08 to branch-25.10 July 29, 2025 17:44
@gerashegalov gerashegalov changed the base branch from branch-25.10 to branch-25.12 September 29, 2025 17:50
@pxLi
Copy link
Member

pxLi commented Nov 17, 2025

NOTE: release/25.12 has been created from main. Please retarget your PR to release/25.12 if it should be included in the release.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@razajafri razajafri Awaiting requested review from razajafri

At least 1 approving review is required to merge this pull request.

Assignees

@gerashegalov gerashegalov

Labels

build Related to CI / CD or cleanly building

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

[FEA] Build against $SPARK_HOME jars instead of Maven

2 participants

@gerashegalov @pxLi