GH-49422: [CI][Integration][Ruby] Add the Ruby implementation

[kou]

Rationale for this change

There are some missing features in the Ruby implmentaion for now but we can pass them by skipping some tests in our integration tests.

What changes are included in this PR?

Archery:

• Add --with-ruby to archery integration
• Add archery.integration.tester_ruby.RubyTester
• Add no_map_field_names_validate quirk for [C++] Map type ignores key/item/value field names #49415
• Show environment variables too on external command failure because Ruby tester uses environment variables not command line arguments to pass information to integration tester
• Use ARCHERY_INTEGRATION_WITH_CPP=1 instead of ARROW_INTEGRATION_CPP=ON like other implementations such as ARCHERY_INTEGRATION_WITH_GO

Ruby:

• Add red-arrow-format-integration-test as the test driver
  • This is not included in .gem because this is only for development
• Add ruby/red-arrow-format/lib/arrow-format/integration/ as helpers of the test driver
  • This is not included in .gem because this is only for development
• Add ArrowFormat::Array#empty?
• Add ArrowFormat::RecordBatch#empty?
• Add ArrowFormat::NullArray#n_nulls
• ArrowFormat::*Array#to_a: Add support for empty case
• Fix Apache Arrow decimal <-> BigDecimal conversion
• ArrowFormat::Bitmap#each: Fix a bug that one bit is ignored
• Move dictionary ID to ArrowFormat::DictionaryType from ArrowFormat::Field
• Add support for V4 union that has validity bitmap
• Add support for no continuation token message for backward compatibility
• ArrowFormat::StreamingReader: Add support for reading schema without calling #each
• ArrowFormat::MapType: Add support for keys sorted
• ArrowFormat::MapType: Always use "key"/"value"/"entries" for field names

Are these changes tested?

Yes.

Are there any user-facing changes?

Yes.

• GitHub Issue: [CI][Integration][Ruby] Add the Ruby implementation to integration targets #49422

[github-actions]

⚠️ GitHub issue #49422 has been automatically assigned in GitHub to PR creator.

[kou]

This is ready.

[kou]

I'll merge this in the next week if nobody objects it.

[kou]

I'll merge this.

[conbench-apache-arrow]

After merging your PR, Conbench analyzed the 3 benchmarking runs that have been run so far on merge-commit ed37b14.

There were no benchmark performance regressions. 🎉

The full Conbench report has more details. It also includes information about 2 possible false positives for unstable benchmarks that are known to sometimes produce them.