Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add more detailed catalog validation #321

Closed
3 tasks
delucchi-cmu opened this issue Jul 31, 2024 · 0 comments · Fixed by #326
Closed
3 tasks

Add more detailed catalog validation #321

delucchi-cmu opened this issue Jul 31, 2024 · 0 comments · Fixed by #326
Assignees
Labels
enhancement New feature or request

Comments

@delucchi-cmu
Copy link
Contributor

Feature request

These should be optional, as some kind of strict validation.

  • Compare the pixels in _metadata with partition_info.csv
  • Compare the pixels in leaf parquet files with partition_info.csv
  • Check that catalog can be loaded as a valid parquet dataset
  • Print some statistics as you run:
    • number of partitions
    • number of rows
    • approximate on-sky coverage (in sq degrees, and in % coverage)

Before submitting
Please check the following:

  • I have described the purpose of the suggested change, specifying what I need the enhancement to accomplish, i.e. what problem it solves.
  • I have included any relevant links, screenshots, environment information, and data relevant to implementing the requested feature, as well as pseudocode for how I want to access the new functionality.
  • If I have ideas for how the new feature could be implemented, I have provided explanations and/or pseudocode and/or task lists for the steps.
@delucchi-cmu delucchi-cmu added the enhancement New feature or request label Jul 31, 2024
@delucchi-cmu delucchi-cmu self-assigned this Aug 1, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
Status: Done
Development

Successfully merging a pull request may close this issue.

1 participant