Skip to content

Conversation

aleksandarskrbic
Copy link

@aleksandarskrbic aleksandarskrbic commented Oct 11, 2025

Fixes #4927. Updates LogSegment.hashCode() to use logical version
numbers instead of file paths. This allows pagination to continue
working when staged commits (X.uuid.json) are published (X.json)
in catalog-managed tables.

Which Delta project/connector is this regarding?

  • Spark
  • Standalone
  • Flink
  • Kernel
  • Other (fill in here)

Description

Updates LogSegment.hashCode() to use logical version numbers instead of file paths

Resolves #4927

How was this patch tested?

Added tests:

  1. src/test/scala/io/delta/kernel/internal/PaginationContextSuite.scala
  2. src/test/scala/io/delta/kernel/internal/snapshot/LogSegmentHashCodeSuite.scala

Does this PR introduce any user-facing changes?

No

  Fixes delta-io#4927. Updates LogSegment.hashCode() to use logical version
  numbers instead of file paths. This allows pagination to continue
  working when staged commits (X.uuid.json) are published (X.json)
  in catalog-managed tables.

  Signed-off-by: Aleksandar Skrbic <[email protected]>
@aleksandarskrbic aleksandarskrbic force-pushed the aleksandarskrbic/fix/pagination-log-segment-validation branch from 0c8f293 to 92f2c42 Compare October 11, 2025 09:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Kernel] Fix Pagination Log Segment Validation for Staged Commit File Renames

1 participant