Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEATURE] add hashdiff and de-duping to effectivity sat macro #223

Open
philmaddocks opened this issue Jan 8, 2024 · 0 comments
Open

[FEATURE] add hashdiff and de-duping to effectivity sat macro #223

philmaddocks opened this issue Jan 8, 2024 · 0 comments
Assignees
Labels
feature This is is requesting a new feature

Comments

@philmaddocks
Copy link

philmaddocks commented Jan 8, 2024

Is your feature request related to a problem? Please describe.
The current effectivity sat macro does no de-duping to see if a relationship has changed over time on the initial load. It relies on being provided relationship changes from a dedicated model rather than being able to be created over the typical stage view from a source table that may contain that relationship. It simply loads all the rows from our stage model, including those that feature no relationship change.

Describe the solution you'd like
I'd like the macro (as per the other sat macros) to de-dupe over a data set in order to identify actual changes to a relationship, based on the provided keys.

Describe alternatives you've considered
Using the standard Sat Macro and having only the effective_from as our "effectivity" i.e. max(effective_from) is the latest relationship record as far as the business is concerned. There are no end_date inserts.

AB#5351

@philmaddocks philmaddocks added the feature This is is requesting a new feature label Jan 8, 2024
@DVAlexHiggs DVAlexHiggs added feature This is is requesting a new feature and removed feature This is is requesting a new feature labels May 15, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature This is is requesting a new feature
Projects
None yet
Development

No branches or pull requests

2 participants