Skip to content

native_shuffle crashes for repartition + count #3846

Closed
#3893
Closed
native_shuffle crashes for repartition + count#3846
#3893
Assignees
comphead
Labels
area:shuffleShuffle (JVM and native)bugSomething isn't workingcrashNative engine crash/panic/segfaultpriority:highCrashes, panics, segfaults, major functional breakage
@comphead

Description

@comphead
comphead
opened on Mar 30, 2026

Describe the bug

Valid query

spark.read.parquet("hdfs://location").repartition(50).count()

Crashes with

org.apache.comet.CometNativeException: External error: Execution error: Error in shuffle write: Arrow error: Invalid argument error: must either specify a row count or at least one column

Steps to reproduce

No response

Expected behavior

should work

Additional context

No response

Metadata

Metadata

Assignees

Labels

area:shuffleShuffle (JVM and native)bugSomething isn't workingcrashNative engine crash/panic/segfaultpriority:highCrashes, panics, segfaults, major functional breakage

Type

No type

Fields

No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions