Skip to content

[flink] Single-row lookup pushdown returns empty for lake-only (expired) partitions #3443

@fresh-borzoni

Description

@fresh-borzoni

Search before asking

  • I searched in the issues and found nothing similar.

Fluss version

main (development)

Please describe the bug 🐞

A full primary-key point query on a lake-enabled partitioned table (FULL) is rewritten to a kv single-row lookup. It reads only Fluss kv, so for a partition expired from Fluss but still in the lake it returns empty, yet the union scan(or a partial-key filter) returns the row.

The COUNT(*) pushdown already guards this via isDataLakeEnabled and the single-row lookup doesn't.

Solution

Gate the lookup on partition liveness, else fall back to the union scan.

Are you willing to submit a PR?

  • I'm willing to submit a PR!

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No fields configured for Bug.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions