Skip to content

Fix preproc db updating - #1769

Merged
mmccrackan merged 2 commits into
masterfrom
261022_preproc_overwrite
Oct 23, 2026
Merged

mmccrackan merged 2 commits into
masterfrom
261022_preproc_overwrite

Conversation

@mmccrackan

@mmccrackan mmccrackan commented Oct 22, 2026 •

Copy link
Copy Markdown
Contributor

The overwrite option in cleanup_mandb in preprocessing was not passed into the Db batch manager add_entry so it always skips updating the entry even if the archive h5 file gets updated. Even if it was passed, it would have been ignored since the Db manager only checks if the entry exists when inspected and not whether replace is True. This means the Db will always refer back to the old preprocessing archive entry if it was in a different file (this happened when trying to backfill with overwrite=True on site).

@mmccrackan
mmccrackan marked this pull request as ready for review October 22, 2026 20:37
@mmccrackan
mmccrackan requested a review from msilvafe October 22, 2026 20:38
@mmccrackan
mmccrackan merged commit 581ad86 into master Oct 23, 2026
5 checks passed
@mmccrackan
mmccrackan deleted the 261022_preproc_overwrite branch October 23, 2026 20:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants