fix: remove fallback for int8 and int16 types with native Parquet readers

[mbutrovich]

Which issue does this PR close?

Closes #2195, #1348.

Rationale for this change

We previously fell back in a scenario where the native reader produced different results. We've now picked up appropriate DF and arrow-rs dependencies to have apache/arrow#7055.

What changes are included in this PR?

Remove the fallback.

How are these changes tested?

Existing tests.

[mbutrovich]

Running Spark SQL tests locally with iceberg_compat. If that passes, I'll likely want to undo #1376 and try again.

[codecov-commenter]

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 43.58%. Comparing base (f09f8af) to head (bbaa3c9).
⚠️ Report is 514 commits behind head on main.

Additional details and impacted files

@@              Coverage Diff              @@
##               main    #2197       +/-   ##
=============================================
- Coverage     56.12%   43.58%   -12.55%     
- Complexity      976     1085      +109     
=============================================
  Files           119      147       +28     
  Lines         11743    13464     +1721     
  Branches       2251     2349       +98     
=============================================
- Hits           6591     5868      -723     
- Misses         4012     6595     +2583     
+ Partials       1140     1001      -139     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

[parthchandra]

You may want to undo parts of #1376 to really test the change. The changes to CometTestBase.getPrimitiveTypesParquetSchema were so that the schema would not contain unsigned types if the reader type was one of the datafusion based readers. Undoing that change will be a primary test.

[mbutrovich]

So instead of getting null on the incorrectly written values we now get different values. So garbage in is still garbage out, but it's new garbage!

[parthchandra]

I seem to recall that I tested a badly written file with apache/arrow#7055 and did not get garbage. I'll take a look at it again.
Thanks for kicking off this effort @mbutrovich!