Test failure: test_table_migration_job_refreshes_migration_status[hiveserde-migrate-external-tables-ctas]

[github-actions]

❌ test_table_migration_job_refreshes_migration_status[hiveserde-migrate-external-tables-ctas]: AssertionError: Workflow failed: assessment (3m19.769s)

AssertionError: Workflow failed: assessment
assert False
[gw1] linux -- Python 3.10.16 /home/runner/work/ucx/ucx/.venv/bin/python
05:32 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.DIqS/config.yml) doesn't exist.
05:32 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
05:32 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data.
05:32 INFO [databricks.labs.ucx.install] Fetching installations...
05:32 WARNING [databricks.labs.ucx.install] Existing installation at /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.DIqS is corrupted. Skipping...
05:32 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
05:32 DEBUG [tests.integration.conftest] Waiting for clusters to start...
05:32 DEBUG [tests.integration.conftest] Waiting for clusters to start...
05:32 INFO [databricks.labs.ucx.install] Installing UCX v0.53.2+1620250112053214
05:32 INFO [databricks.labs.ucx.install] Creating ucx schemas...
05:32 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups
05:32 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental
05:32 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental
05:32 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migration-progress-experimental
05:32 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation
05:32 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups
05:32 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-legacy
05:32 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables
05:32 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment
05:32 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental
05:32 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions
05:32 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas
05:32 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing
05:32 INFO [databricks.labs.ucx.install] Creating dashboards...
05:32 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views...
05:32 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment...
05:32 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration...
05:32 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress...
05:32 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive...
05:32 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates...
05:32 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main...
05:32 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV...
05:32 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups...
05:32 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main...
05:32 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main...
05:32 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:32 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:32 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:32 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:32 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:32 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:32 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:32 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.DIqS/README for the next steps.
05:32 INFO [databricks.labs.ucx.progress.install] Installation completed successfully!
05:32 DEBUG [databricks.labs.ucx.installer.workflows] starting assessment job: https://DATABRICKS_HOST#job/98200040805967
05:32 INFO [databricks.labs.ucx.installer.workflows] Started assessment job: https://DATABRICKS_HOST#job/98200040805967/runs/455076719792524
05:32 DEBUG [databricks.labs.ucx.installer.workflows] Validating assessment workflow: https://DATABRICKS_HOST#job/98200040805967
05:32 INFO [databricks.labs.ucx.installer.workflows] Identified a run in progress waiting for run completion
05:32 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.DIqS/config.yml) doesn't exist.
05:32 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
05:32 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data.
05:32 INFO [databricks.labs.ucx.install] Fetching installations...
05:32 WARNING [databricks.labs.ucx.install] Existing installation at /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.DIqS is corrupted. Skipping...
05:32 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
05:32 DEBUG [tests.integration.conftest] Waiting for clusters to start...
05:32 DEBUG [tests.integration.conftest] Waiting for clusters to start...
05:32 INFO [databricks.labs.ucx.install] Installing UCX v0.53.2+1620250112053214
05:32 INFO [databricks.labs.ucx.install] Creating ucx schemas...
05:32 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups
05:32 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental
05:32 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental
05:32 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migration-progress-experimental
05:32 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation
05:32 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups
05:32 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-legacy
05:32 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables
05:32 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment
05:32 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental
05:32 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions
05:32 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas
05:32 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing
05:32 INFO [databricks.labs.ucx.install] Creating dashboards...
05:32 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views...
05:32 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment...
05:32 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration...
05:32 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress...
05:32 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive...
05:32 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates...
05:32 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main...
05:32 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV...
05:32 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups...
05:32 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main...
05:32 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main...
05:32 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:32 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:32 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:32 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:32 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:32 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:32 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:32 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.DIqS/README for the next steps.
05:32 INFO [databricks.labs.ucx.progress.install] Installation completed successfully!
05:32 DEBUG [databricks.labs.ucx.installer.workflows] starting assessment job: https://DATABRICKS_HOST#job/98200040805967
05:32 INFO [databricks.labs.ucx.installer.workflows] Started assessment job: https://DATABRICKS_HOST#job/98200040805967/runs/455076719792524
05:32 DEBUG [databricks.labs.ucx.installer.workflows] Validating assessment workflow: https://DATABRICKS_HOST#job/98200040805967
05:32 INFO [databricks.labs.ucx.installer.workflows] Identified a run in progress waiting for run completion
05:34 INFO [databricks.labs.ucx.install] Deleting UCX v0.53.2+1620250112053214 from https://DATABRICKS_HOST
05:34 INFO [databricks.labs.ucx.install] Deleting inventory database dummy_slv3b
05:34 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=165766925340016, as it is no longer needed
05:34 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=1005236547364658, as it is no longer needed
05:34 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=1065833064219975, as it is no longer needed
05:34 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=186522238723086, as it is no longer needed
05:34 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=550885165460648, as it is no longer needed
05:34 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=1122488022692909, as it is no longer needed
05:34 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=1088632601902456, as it is no longer needed
05:34 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=295967340552212, as it is no longer needed
05:34 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=98200040805967, as it is no longer needed
05:34 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=145559913747852, as it is no longer needed
05:34 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=80276341855983, as it is no longer needed
05:34 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=546700217927621, as it is no longer needed
05:34 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=193770762332939, as it is no longer needed
05:34 INFO [databricks.labs.ucx.install] Deleting cluster policy
05:34 INFO [databricks.labs.ucx.install] Deleting secret scope
05:34 INFO [databricks.labs.ucx.install] UnInstalling UCX complete
[gw1] linux -- Python 3.10.16 /home/runner/work/ucx/ucx/.venv/bin/python

_{Running from nightly #348}