[FEATURE]: Support enabling Iceberg reads on Delta tables (Uniform) in bulk on all eligible tables

[ankitshah-db]

Is there an existing issue for this?

• I have searched the existing issues

Problem statement

As tables are being migrated from ext. HMS to UC, can UCX be extended to enable Iceberg Reads (Uniform) on those tables in bulk, especially when they have Deletion Vectors enabled

Proposed Solution

Step 1: Run the ‘REORG TABLE ... APPLY (PURGE)’ command followed by
Step 2: ‘REORG TABLE .. APPLY (UPGRADE UNIFORM(ICEBERG_COMPAT_VERSION= ..))’

Additional Context

No response

[JCZuurmond]

Hi @ankitshah-db , thank you for opening an issue. Why did you open this issue for UCX? Is it related to Unity Catalog migration? The request reads like something separate from Hive metastore and UC migrations

[ankitshah-db]

@JCZuurmond our customer is about to migrate thousands of tables from ext HMS to UC using UCX and wants to enable Uniform on all of them. We are hoping UCX can help with the bulk migration and help enable Uniform as well. Basically run the ALTER table commands on the migrated tables:
ALTER TABLE table_name SET TBLPROPERTIES(
'delta.enableIcebergCompatV2' = 'true',
'delta.universalFormat.enabledFormats' = 'iceberg');