Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Aggregate to check for duplicates #112

Open
leppott opened this issue Feb 3, 2021 · 0 comments
Open

Aggregate to check for duplicates #112

leppott opened this issue Feb 3, 2021 · 0 comments

Comments

@leppott
Copy link
Owner

leppott commented Feb 3, 2021

Is your feature request related to a problem? Please describe.
Users sometimes have files with overlapping time periods. Current version of Aggregate simply appends files resulting in duplicates.

Describe the solution you'd like
Not sure see alternatives.

Describe alternatives you've considered

  1. Alert users so can modify input data. Maybe stop if datetimes overlap an give info in stop message.
  2. Use Unique to get rid of duplicates. But only if exact. If any differences then still have dup records. Would still need a check.

Additional context
Users should have data stored only in one file but many users have the same date range in multiple files. Current "append" leads to extra time figuring out what went wrong and which data to retain.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant