-
Notifications
You must be signed in to change notification settings - Fork 254
Closed
Labels
Spark 4.0+Spark 4.0+ issuesSpark 4.0+ issuesbugSomething isn't workingSomething isn't workingtestOnly impacts testsOnly impacts tests
Description
Describe the bug
Below unit tests(scala tests) are failing in OrcScanSuite
Total test failures: 2
- Test ORC count chunked by rows *** FAILED ***
java.lang.IllegalArgumentException: Part of the plan is not columnar class org.apache.spark.sql.execution.aggregate.HashAggregateExec
HashAggregate(keys=[], functions=[count(1)], output=[count#193L])
+- HashAggregate(keys=[], functions=[partial_count(1)], output=[count#222L])
+- GpuColumnarToRow false
+- GpuShuffleCoalesce 1073741824
+- GpuColumnarExchange gpusinglepartitioning$(), REPARTITION_BY_NUM, [plan_id=209], [loreId=1]
+- GpuFileGpuScan orc [] Batched: true, DataFilters: [], Format: ORC, Location: InMemoryFileIndex[file:/home/nartal/spark-rapids-2410/spark-rapids/scala2.13/tests/target/spark40..., PartitionFilters: [], PushedFilters: [], ReadSchema: struct<>
Steps/Code to reproduce bug
$ mvn package -f scala2.13/pom.xml -pl tests -am -Dbuildver=400 -Dsuffixes=".*OrcScanSuite"
Expected behavior
Tests must either pass or skip with valid reason in the test suite.
Metadata
Metadata
Assignees
Labels
Spark 4.0+Spark 4.0+ issuesSpark 4.0+ issuesbugSomething isn't workingSomething isn't workingtestOnly impacts testsOnly impacts tests