Skip to content

[BUG] Spark-4.0: Tests failures in OrcScanSuite #12018

@nartal1

Description

@nartal1

Describe the bug
Below unit tests(scala tests) are failing in OrcScanSuite
Total test failures: 2

- Test ORC count chunked by rows *** FAILED ***
  java.lang.IllegalArgumentException: Part of the plan is not columnar class org.apache.spark.sql.execution.aggregate.HashAggregateExec
HashAggregate(keys=[], functions=[count(1)], output=[count#193L])
+- HashAggregate(keys=[], functions=[partial_count(1)], output=[count#222L])
   +- GpuColumnarToRow false
      +- GpuShuffleCoalesce 1073741824
         +- GpuColumnarExchange gpusinglepartitioning$(), REPARTITION_BY_NUM, [plan_id=209], [loreId=1]
            +- GpuFileGpuScan orc [] Batched: true, DataFilters: [], Format: ORC, Location: InMemoryFileIndex[file:/home/nartal/spark-rapids-2410/spark-rapids/scala2.13/tests/target/spark40..., PartitionFilters: [], PushedFilters: [], ReadSchema: struct<>

Steps/Code to reproduce bug

$ mvn package -f scala2.13/pom.xml -pl tests -am -Dbuildver=400 -Dsuffixes=".*OrcScanSuite"

Expected behavior
Tests must either pass or skip with valid reason in the test suite.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Spark 4.0+Spark 4.0+ issuesbugSomething isn't workingtestOnly impacts tests

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions