Skip to content

fix: native error message not propagated to SparkException on empty errorClass#3727

Merged
parthchandra merged 1 commit intoapache:mainfrom
manuzhang:fix-SparkErrorConverter
Mar 24, 2026
Merged

fix: native error message not propagated to SparkException on empty errorClass#3727
parthchandra merged 1 commit intoapache:mainfrom
manuzhang:fix-SparkErrorConverter

Conversation

@manuzhang
Copy link
Copy Markdown
Member

Closes #3726.

@manuzhang
Copy link
Copy Markdown
Member Author

@parthchandra Please help review when you are free.

@mbutrovich
Copy link
Copy Markdown
Contributor

The original issue references a test failing, are we passing that now? Do we need to make any changes to the test (are we skipping it?)

@manuzhang
Copy link
Copy Markdown
Member Author

@mbutrovich The failure was from previous commit of #2897, not on the main branch.

Copy link
Copy Markdown
Contributor

@parthchandra parthchandra left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This change is fine. It would be good to know what the root cause of the failure was and to ensure that the error is actually handled correctly in native.

@manuzhang
Copy link
Copy Markdown
Member Author

@mbutrovich @parthchandra Any more comments?

@parthchandra
Copy link
Copy Markdown
Contributor

@manuzhang approved, but can you tell us what failure resulted in an empty error class?

@parthchandra parthchandra merged commit 09a7ebb into apache:main Mar 24, 2026
111 checks passed
@manuzhang
Copy link
Copy Markdown
Member Author

manuzhang commented Mar 24, 2026

@parthchandra Thanks for review. I tagged you in https://github.com/apache/datafusion-comet/pull/2897/changes#r2978425219 for the failure case.

@parthchandra
Copy link
Copy Markdown
Contributor

Merged. Thank you. @manuzhang

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Native error is not propagated to SparkException when errorClass is empty

3 participants