-
Notifications
You must be signed in to change notification settings - Fork 140
Closed
Labels
Description
Describe the bug
When running Zingg version 0.5.0 on Databricks, the Match phase completes but does not produce any output unless a checkpoint directory is explicitly set.
Steps to reproduce the issue
- Run a Databricks notebook using the Zingg 0.5.0 JAR.
- Do not set a checkpoint directory before executing the Match phase.
- Execute the Match phase.
- Result: The Match phase completes but no output is generated.
- Set a checkpoint directory.
- Re-run the Match phase.
- Result: The Match phase succeeds and the output is generated correctly.
Expected behavior
The Match phase should run successfully and output should be generated correctly even if the checkpoint directory is not explicitly set by the user.
Environment details
- Platform: Databricks
- Databricks Runtime Version: 16.4 LTS (includes Apache Spark 3.5.2, Scala 2.12)
- Zingg Version: 0.5.0
- Cluster Type: Single node