test(csharp/src/Drivers): add Spice.ai test target

[sgrebnov]

Add Spice.ai OSS test target for FlightSQL C# interop driver to test compatibility with arrow-rs FlightSQL implementation.

• Interop/FlightSql: add SpiceAI environment type support (test data, example configuration)
• ci: spin up Spice test server using docker compose
• ci: extend integration tests to include FligthSQL C# Interop integration tests. This can be extended to include more tests targets via configuration files similar to ci/configs/flightsql-spiceai.json added in this PR

Example test run: https://github.com/apache/arrow-adbc/actions/runs/15597223474/job/43930217202?pr=2961

Testing against ADBC helped to identify and fix:

• Update FlightSQL GetDbSchemas and GetTables schemas to fully match the protocol arrow-rs#7638

[lidavidm]

Shouldn't we test the driver directly instead of through C#?

[sgrebnov]

@lidavidm - thank you for review!

Shouldn't we test the driver directly instead of through C#?

Good point. The reason the test was added based on the C# interop driver is to cover both:

• general ADBC compatibility (based on internal usage of the Go ADBC driver)
• full support/integration with clients based on the C# interop driver (important)

Looking for recommendations/guidance here, will update as needed.

[lidavidm]

@zeroshade what's your opinion here?

[CurtHagenlocher]

Shouldn't we test the driver directly instead of through C#?

I'm happy to have both types of tests; we also have C# tests for Flight interop with Denodo and Dremio. The bulk of the maintenance is likely to be in the Docker test fixture and that can be shared.

[CurtHagenlocher]

Thanks! I'm not the best person to comment on the workflow and test setup changes, but the C# changes look good to me, modulo a few nits.

[CurtHagenlocher]

Thanks! This looks good to me, but perhaps @lidavidm or @kou can take a look at the CI changes?

[kou]

(Sorry for hijacking here but... @CurtHagenlocher could you check apache/arrow#46752 (comment) ? I want to proceed moving csharp/ in apache/arrow to apache/arrow-dotnet.)