Fix non-nullable under nullable struct write

[revans2]

This fixes #11762

But we need to be careful and coordinate this with #11763 because I think we are going to disable boolean writes for all of ORC.

[revans2]

build

[jihoonson]

LGTM

[revans2]

build

[revans2]

@jlowe please take another look

[jlowe]

build

[jlowe]

Test failures in CI

[2024-12-11T22:26:54.226Z] FAILED ../../src/main/python/orc_write_test.py::test_write_round_trip_nullable_struct[native-Boolean(not_null)][DATAGEN_SEED=1733949546, TZ=UTC] - pyspark.sql.utils.IllegalArgumentException: Part of the plan is not columnar class org.apache.spark.sql.execution.command.DataWritingCommandExec
[2024-12-11T22:26:54.226Z] Execute InsertIntoHadoopFsRelationCommand file:/tmp/pyspark_tests/premerge-ci-2-jenkins-rapids-premerge-github-10369-qjm3n-vdg90-gw1-2497-46613182/ORC_DATA/GPU, false, ORC, [path=/tmp/pyspark_tests//premerge-ci-2-jenkins-rapids-premerge-github-10369-qjm3n-vdg90-gw1-2497-46613182//ORC_DATA/GPU], ErrorIfExists, [a]
[2024-12-11T22:26:54.226Z] +- Scan ExistingRDD[a#161900]
[2024-12-11T22:26:54.226Z] FAILED ../../src/main/python/orc_write_test.py::test_write_round_trip_nullable_struct[hive-Boolean(not_null)][DATAGEN_SEED=1733949546, TZ=UTC] - pyspark.sql.utils.IllegalArgumentException: Part of the plan is not columnar class org.apache.spark.sql.execution.command.DataWritingCommandExec
[2024-12-11T22:26:54.226Z] Execute InsertIntoHadoopFsRelationCommand file:/tmp/pyspark_tests/premerge-ci-2-jenkins-rapids-premerge-github-10369-qjm3n-vdg90-gw1-2497-86215200/ORC_DATA/GPU, false, ORC, [path=/tmp/pyspark_tests//premerge-ci-2-jenkins-rapids-premerge-github-10369-qjm3n-vdg90-gw1-2497-86215200//ORC_DATA/GPU], ErrorIfExists, [a]
[2024-12-11T22:26:54.226Z] +- Scan ExistingRDD[a#162002]

I suspect this is because booleans are in the datagen and we recently changed to fallback on ORC writes of booleans.

[revans2]

build

[revans2]

@jlowe please take another look

[revans2]

build