Test failure: test_running_real_assessment_job

[github-actions]

❌ test_running_real_assessment_job: AssertionError: Workflow failed: assessment (8m34.273s)

AssertionError: Workflow failed: assessment
assert False
 +  where False = validate_step('assessment')
 +    where validate_step = <databricks.labs.ucx.installer.workflows.DeployedWorkflows object at 0x7f85208d2710>.validate_step
 +      where <databricks.labs.ucx.installer.workflows.DeployedWorkflows object at 0x7f85208d2710> = <tests.integration.conftest.MockInstallationContext object at 0x7f852088c4c0>.deployed_workflows
[gw2] linux -- Python 3.10.15 /home/runner/work/ucx/ucx/.venv/bin/python
05:07 INFO [tests.integration.conftest] Dashboard Created ucx_DPpAv_ra78b336db: https://DATABRICKS_HOST/sql/dashboards/38b1a8a6-65e0-4193-87cd-a88db6671a3f
05:07 INFO [tests.integration.conftest] Dashboard Created ucx_DF4T4_ra78b336db: https://DATABRICKS_HOST/sql/dashboards/88999be5-8241-4c7f-beea-c77a246636e1
05:08 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.jsqI/config.yml) doesn't exist.
05:08 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
05:08 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data.
05:08 INFO [databricks.labs.ucx.install] Fetching installations...
05:08 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
05:08 DEBUG [tests.integration.conftest] Waiting for clusters to start...
05:12 DEBUG [tests.integration.conftest] Waiting for clusters to start...
05:12 INFO [databricks.labs.ucx.install] Installing UCX v0.53.2+1020250109051239
05:12 INFO [databricks.labs.ucx.install] Creating ucx schemas...
05:12 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups
05:12 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-legacy
05:12 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables
05:12 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment
05:12 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migration-progress-experimental
05:12 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental
05:12 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation
05:12 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental
05:12 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental
05:12 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas
05:12 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing
05:12 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups
05:12 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions
05:12 INFO [databricks.labs.ucx.install] Creating dashboards...
05:12 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views...
05:12 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment...
05:12 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration...
05:12 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress...
05:12 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive...
05:12 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates...
05:12 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main...
05:12 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV...
05:12 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups...
05:12 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main...
05:12 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main...
05:12 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:12 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:12 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:12 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:12 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:12 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:12 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:12 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.jsqI/README for the next steps.
05:12 DEBUG [databricks.labs.ucx.installer.workflows] starting assessment job: https://DATABRICKS_HOST#job/692905566716497
05:12 INFO [databricks.labs.ucx.installer.workflows] Started assessment job: https://DATABRICKS_HOST#job/692905566716497/runs/1067668630061845
05:12 DEBUG [databricks.labs.ucx.installer.workflows] Waiting for completion of assessment job: https://DATABRICKS_HOST#job/692905566716497/runs/1067668630061845
05:15 INFO [databricks.labs.ucx.installer.workflows] Completed assessment job run 1067668630061845 with state: RunResultState.SUCCESS_WITH_FAILURES (The job run succeeded with 20 failed tasks)
05:15 INFO [databricks.labs.ucx.installer.workflows] Completed assessment job run 1067668630061845 duration: 0:02:28.640000 (2025-01-09 05:12:54.984000+00:00 thru 2025-01-09 05:15:23.624000+00:00)
05:15 DEBUG [databricks.labs.ucx.installer.workflows] Validating assessment workflow: https://DATABRICKS_HOST#job/692905566716497
05:07 INFO [tests.integration.conftest] Dashboard Created ucx_DPpAv_ra78b336db: https://DATABRICKS_HOST/sql/dashboards/38b1a8a6-65e0-4193-87cd-a88db6671a3f
05:07 INFO [tests.integration.conftest] Dashboard Created ucx_DF4T4_ra78b336db: https://DATABRICKS_HOST/sql/dashboards/88999be5-8241-4c7f-beea-c77a246636e1
05:08 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.jsqI/config.yml) doesn't exist.
05:08 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
05:08 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data.
05:08 INFO [databricks.labs.ucx.install] Fetching installations...
05:08 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
05:08 DEBUG [tests.integration.conftest] Waiting for clusters to start...
05:12 DEBUG [tests.integration.conftest] Waiting for clusters to start...
05:12 INFO [databricks.labs.ucx.install] Installing UCX v0.53.2+1020250109051239
05:12 INFO [databricks.labs.ucx.install] Creating ucx schemas...
05:12 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups
05:12 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-legacy
05:12 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables
05:12 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment
05:12 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migration-progress-experimental
05:12 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental
05:12 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation
05:12 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental
05:12 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental
05:12 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas
05:12 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing
05:12 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups
05:12 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions
05:12 INFO [databricks.labs.ucx.install] Creating dashboards...
05:12 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views...
05:12 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment...
05:12 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration...
05:12 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress...
05:12 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive...
05:12 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates...
05:12 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main...
05:12 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV...
05:12 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups...
05:12 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main...
05:12 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main...
05:12 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:12 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:12 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:12 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:12 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:12 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:12 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:12 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.jsqI/README for the next steps.
05:12 DEBUG [databricks.labs.ucx.installer.workflows] starting assessment job: https://DATABRICKS_HOST#job/692905566716497
05:12 INFO [databricks.labs.ucx.installer.workflows] Started assessment job: https://DATABRICKS_HOST#job/692905566716497/runs/1067668630061845
05:12 DEBUG [databricks.labs.ucx.installer.workflows] Waiting for completion of assessment job: https://DATABRICKS_HOST#job/692905566716497/runs/1067668630061845
05:15 INFO [databricks.labs.ucx.installer.workflows] Completed assessment job run 1067668630061845 with state: RunResultState.SUCCESS_WITH_FAILURES (The job run succeeded with 20 failed tasks)
05:15 INFO [databricks.labs.ucx.installer.workflows] Completed assessment job run 1067668630061845 duration: 0:02:28.640000 (2025-01-09 05:12:54.984000+00:00 thru 2025-01-09 05:15:23.624000+00:00)
05:15 DEBUG [databricks.labs.ucx.installer.workflows] Validating assessment workflow: https://DATABRICKS_HOST#job/692905566716497
05:15 INFO [databricks.labs.ucx.install] Deleting UCX v0.53.2+1020250109051239 from https://DATABRICKS_HOST
05:15 INFO [databricks.labs.ucx.install] Deleting inventory database dummy_slsr1
05:15 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=900264637919007, as it is no longer needed
05:15 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=271376102339443, as it is no longer needed
05:15 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=510209212542859, as it is no longer needed
05:15 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=692905566716497, as it is no longer needed
05:15 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=95995246012648, as it is no longer needed
05:15 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=837981024765154, as it is no longer needed
05:15 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=620846203948775, as it is no longer needed
05:15 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=497020987212390, as it is no longer needed
05:15 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=750085189231710, as it is no longer needed
05:15 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=997057125599934, as it is no longer needed
05:15 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=297801093955158, as it is no longer needed
05:15 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=43269082989236, as it is no longer needed
05:15 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=485256504813865, as it is no longer needed
05:15 INFO [databricks.labs.ucx.install] Deleting cluster policy
05:15 INFO [databricks.labs.ucx.install] Deleting secret scope
05:15 INFO [databricks.labs.ucx.install] UnInstalling UCX complete
[gw2] linux -- Python 3.10.15 /home/runner/work/ucx/ucx/.venv/bin/python

_{Running from nightly #344}