-
Notifications
You must be signed in to change notification settings - Fork 13
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Hash value comparison: new record is not loaded, if the same hash value exist in older record. #13
Comments
Fix of: dataform-co#13 Fix of: new records are not loaded, if _updates table is empty.
if your source table had unique records and it updated the record with new hash, will it be still an issue? |
I'm not sure I understand what you mean. |
In addition to your input data you need to have an incremental model with |
@nnikolov84 is correct. Take this example And this is the output after calling scd. |
When using hash value comparison, new record is not loaded, if the same hash value exist in older record.
Input data:
The third value in the table will not be processed. This is happening, because when generating "ids_to_update", the historical records are not filtered.
In order for the process to work properly, only most recent record per KEY should be compared to the input data.
Possible solution is:
The text was updated successfully, but these errors were encountered: