Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Redshift patch #170

Open
wants to merge 38 commits into
base: main
Choose a base branch
from
Open

Redshift patch #170

Show file tree
Hide file tree
Changes from 15 commits
Commits
Show all changes
38 commits
Select commit Hold shift + click to select a range
df6dcc4
Merge pull request #167 from ScalefreeCOM/main
thoffmann-sf Apr 16, 2024
4a9f585
Update ghost_record_per_datatype.sql
thoffmann-sf Apr 16, 2024
bb45d46
Update control_snap_v0.sql
thoffmann-sf Apr 16, 2024
ebf3bfa
Update ref_sat_v0.sql
thoffmann-sf Apr 16, 2024
c21807d
Update sat_v0.sql
thoffmann-sf Apr 16, 2024
776fa0a
Update hash_standardization.sql
thoffmann-sf Apr 16, 2024
f74cf18
Update hash_standardization.sql
thoffmann-sf Apr 16, 2024
9ed2422
Deleted Variable for postgres and redshift
thoffmann-sf Apr 19, 2024
dd2d2ab
Deleted variables for Postgres and Redshift
thoffmann-sf Apr 19, 2024
b0fd448
Added Variables to RedShift
thoffmann-sf Apr 19, 2024
406aaa7
Fixed the RedShift Macro
thoffmann-sf Apr 19, 2024
debb6e4
Added Changes to postgres
thoffmann-sf Apr 19, 2024
db46c57
Fixed copying errors
thoffmann-sf Apr 19, 2024
196cc84
Added LEDTS Alias to the ref_sat_v1 for Postgres and RedShift
thoffmann-sf Apr 19, 2024
2f0f8d1
Deleted the Logs directory
thoffmann-sf Apr 26, 2024
9b9cf64
Update hash_standardization.sql
thoffmann-sf May 3, 2024
d2d91f2
fix: change hash_datatype from BINARY(16) to VARCHAR(32) for redshift
tankim May 3, 2024
fb58988
Merge pull request #172 from tankim/issue-171
thoffmann-sf May 13, 2024
ab7b6b7
change global hash_datatype to string
tkiehn May 13, 2024
5a10b8b
change hardcoded hash datatype defaults to varchar(32) for redshift
tkiehn May 13, 2024
4328e00
Merge pull request #177 from tkiehn/tkiehn-redshift-patch
thoffmann-sf May 13, 2024
a6c0bb5
Adapter specific process_columns_to_select
tkirschke May 17, 2024
3739cbf
Added return() to process_columns_to_select
tkirschke May 21, 2024
e504879
Update stage_processing_macros.sql
thoffmann-sf May 21, 2024
8e3fc25
Update ghost_record_per_datatype.sql
thoffmann-sf May 21, 2024
edda362
Update hub.sql
thoffmann-sf May 21, 2024
72b0304
Update sat_v0.sql
thoffmann-sf May 21, 2024
13008d1
Update sat_v0.sql
thoffmann-sf May 21, 2024
fa640fc
Update sat_v0.sql
thoffmann-sf May 21, 2024
c4488fc
Update stage_processing_macros.sql
thoffmann-sf May 21, 2024
7dfc4fd
Update sat_v1.sql
thoffmann-sf May 21, 2024
152919a
Update sat_v1.sql
thoffmann-sf May 21, 2024
333de43
Update ref_sat_v0.sql
thoffmann-sf May 24, 2024
97a1328
Update ref_sat_v1.sql
thoffmann-sf May 24, 2024
558917b
Merge branch 'redshift-patch' into tkirschke-patch-3
thoffmann-sf May 24, 2024
79537e8
Merge pull request #180 from ScalefreeCOM/tkirschke-patch-3
thoffmann-sf May 24, 2024
e71396d
Update multikey.sql
thoffmann-sf Jun 17, 2024
c89e467
Update multikey.sql
thoffmann-sf Jun 17, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
106,818 changes: 0 additions & 106,818 deletions logs/dbt.log
View file
Open in desktop

This file was deleted.

20 changes: 11 additions & 9 deletions macros/staging/hash_columns.sql
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -91,33 +91,35 @@
{%- endif -%}


{%- else -%}

{%- else -%}
{% if columns[col] is mapping and columns[col].is_hashdiff -%}
{%- if columns[col].use_rtrim -%}
{%- set rtrim_hashdiff = true -%}
{%- else -%}
{%- set rtrim_hashdiff = false -%}
{%- endif -%}

{{- datavault4dbt.hash(columns=columns[col]['columns'],
alias=col,
is_hashdiff=columns[col]['is_hashdiff'],
rtrim_hashdiff=rtrim_hashdiff) -}}
is_hashdiff=columns[col]['is_hashdiff']) -}}

{%- elif columns[col] is not mapping -%}

{{- datavault4dbt.hash(columns=columns[col],
alias=col,
is_hashdiff=false) -}}

{%- elif columns[col] is mapping and not columns[col].is_hashdiff -%}

{%- if execute -%}
{%- do exceptions.warn("[" ~ this ~ "] Warning: You provided a list of columns under a 'columns' key, but did not provide the 'is_hashdiff' flag. Use list syntax for PKs.") -%}
{% endif %}

{{- datavault4dbt.hash(columns=columns[col]['columns'], alias=col) -}}

{%- endif -%}

{{- ",\n" if not loop.last -}}

{%- endif -%}

{%- endfor -%}

{%- endif %}
{%- endmacro -%}

57 changes: 32 additions & 25 deletions macros/supporting/ghost_record_per_datatype.sql
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -347,43 +347,50 @@
{%- set beginning_of_all_times = datavault4dbt.beginning_of_all_times() -%}
{%- set end_of_all_times = datavault4dbt.end_of_all_times() -%}
{%- set timestamp_format = datavault4dbt.timestamp_format() -%}

{%- set beginning_of_all_times_date = var('datavault4dbt.beginning_of_all_times_date', '0001-01-01') -%}
{%- set end_of_all_times_date = var('datavault4dbt.end_of_all_times_date', '8888-12-31') -%}
{%- set date_format = var('datavault4dbt.date_format', 'YYYY-mm-dd') -%}

{%- set unknown_value__STRING = var('datavault4dbt.unknown_value__STRING', '(unknown)') -%}
{%- set error_value__STRING = var('datavault4dbt.error_value__STRING', '(error)') -%}
{%- set hash = datavault4dbt.hash_method() -%}
{%- set hash_default_values = datavault4dbt.hash_default_values(hash_function=hash) -%}
{%- set hash_alg= hash_default_values['hash_alg'] -%}
{%- set unknown_value__HASHTYPE = hash_default_values['unknown_key'] -%}
{%- set error_value__HASHTYPE = hash_default_values['error_key'] -%}
{%- set datatype = datatype | string | upper | trim -%}

{%- if ghost_record_type == 'unknown' -%}
{%- if datatype == 'TIMESTAMP' %} {{ datavault4dbt.string_to_timestamp( timestamp_format , beginning_of_all_times) }} as {{ alias }}
{%- if datatype in ['TIMESTAMPTZ','TIMESTAMP'] %}{{ datavault4dbt.string_to_timestamp(timestamp_format, beginning_of_all_times_date) }} AS {{ alias }}
{%- elif datatype == 'TIMETZ' %} CAST('00:00:01 UTC' as TIMETZ) as {{ alias }}
{%- elif datatype == 'TIME' %} CAST('00:00:01' as TIME) as {{ alias }}
{%- elif datatype == 'DATE'-%} TO_DATE('{{ beginning_of_all_times_date }}', '{{ date_format }}' ) as "{{ alias }}"
{%- elif datatype == 'VARCHAR' %} '{{unknown_value__STRING}}' as {{ alias }}
{%- elif datatype == 'CHARACTER' %} '{{unknown_value__STRING}}' as {{ alias }}
{%- elif datatype == 'INT' %} CAST('0' as INT) as {{ alias }}
{%- elif datatype == 'INT2' %} CAST('0' as INT2) as {{ alias }}
{%- elif datatype == 'INT8' %} CAST('0' as INT8) as {{ alias }}
{%- elif datatype == 'NUMERIC' %} CAST('0' as NUMERIC) as {{ alias }}
{%- elif datatype == 'FLOAT4' %} CAST('0' as FLOAT4) as {{ alias }}
{%- elif datatype == 'FLOAT' %} CAST('0' as FLOAT) as {{ alias }}
{%- elif datatype == 'BOOLEAN' %} CAST('FALSE' as BOOLEAN) as {{ alias }}
{%- elif datatype == 'VARBINARY' %} 'NULL'::varbyte as {{ alias }}
{%- elif datatype == 'VARCHAR' or datatype == 'CHARACTER VARYING' or datatype == 'NVARCHAR' or datatype == 'TEXT' %} '{{unknown_value__STRING}}' as {{ alias }}
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

please group the datatypes into array for ease of extending this code in the future, see line 363.
Same for the following code lines.

{%- elif datatype == 'CHAR' or datatype == 'CHARACTER' or datatype == 'NCHAR' or datatype == 'BPCHAR' %} '{{unknown_value__STRING}}' as {{ alias }}
{%- elif datatype == 'INTEGER' or datatype == 'INT' or datatype == 'INT4' %} CAST('0' as INT) as {{ alias }}
{%- elif datatype == 'SMALLINT' or datatype == 'INT2' %} CAST('0' as INT2) as {{ alias }}
{%- elif datatype == 'BIGINT' or datatype == 'INT8' %} CAST('0' as INT8) as {{ alias }}
{%- elif 'DECIMAL' in datatype or 'NUMERIC' in datatype %} CAST('0' as {{ datatype }}) as {{ alias }}
{%- elif datatype == 'REAL' or datatype == 'FLOAT4' %} CAST('0' as FLOAT4) as {{ alias }}
{%- elif datatype == 'DOUBLE PRECISION' or datatype == 'FLOAT' or datatype == 'FLOAT8' %} CAST('0' as FLOAT) as {{ alias }}
{%- elif datatype == 'BOOLEAN' or datatype == 'BOOL' %} CAST('TRUE' as BOOLEAN) as {{ alias }}
{%- elif datatype == 'VARBYTE' or datatype == 'VARBINARY' or datatype == 'BINARY VARYING' %} CAST('{{ unknown_value__HASHTYPE }}' as {{ datatype }}) as "{{ alias }}"
{%- else %} CAST(NULL as {{ datatype }}) as {{ alias }}
{% endif %}
{%- elif ghost_record_type == 'error' -%}
{%- if datatype == 'TIMESTAMP' %} {{ datavault4dbt.string_to_timestamp( timestamp_format , end_of_all_times) }} as {{ alias }}
{%- elif ghost_record_type == 'error' -%}
{%- if datatype in ['TIMESTAMPTZ','TIMESTAMP'] %}{{ datavault4dbt.string_to_timestamp(timestamp_format, end_of_all_times) }} AS {{ alias }}
{%- elif datatype == 'TIMETZ' %} CAST('23:59:59 UTC' as TIMETZ) as {{ alias }}
{%- elif datatype == 'TIME' %} CAST('23:59:59' as TIME) as {{ alias }}
{%- elif datatype == 'DATE'-%} TO_DATE('{{ end_of_all_times_date }}', '{{ date_format }}' ) as "{{ alias }}"
{%- elif datatype == 'VARCHAR' %} '{{error_value__STRING}}' as {{ alias }}
{%- elif datatype == 'CHARACTER' %} '{{error_value__STRING}}' as {{ alias }}
{%- elif datatype == 'INT' %} CAST('-1' as INT) as {{ alias }}
{%- elif datatype == 'INT2' %} CAST('-1' as INT2) as {{ alias }}
{%- elif datatype == 'INT8' %} CAST('-1' as INT8) as {{ alias }}
{%- elif datatype == 'NUMERIC' %} CAST('-1' as NUMERIC) as {{ alias }}
{%- elif datatype == 'FLOAT4' %} CAST('-1' as FLOAT4) as {{ alias }}
{%- elif datatype == 'FLOAT' %} CAST('-1' as FLOAT) as {{ alias }}
{%- elif datatype == 'BOOLEAN' %} CAST('FALSE' as BOOLEAN) as {{ alias }}
{%- elif datatype == 'VARBINARY' %} 'NULL'::varbyte as {{ alias }}
{%- elif datatype == 'VARCHAR' or datatype == 'CHARACTER VARYING' or datatype == 'NVARCHAR' or datatype == 'TEXT' %} '{{error_value__STRING}}' as {{ alias }}
{%- elif datatype == 'CHAR' or datatype == 'CHARACTER' or datatype == 'NCHAR' or datatype == 'BPCHAR' %} '{{error_value__STRING}}' as {{ alias }}
{%- elif datatype == 'INTEGER' or datatype == 'INT' or datatype == 'INT4' %} CAST('-1' as INT) as {{ alias }}
{%- elif datatype == 'SMALLINT' or datatype == 'INT2' %} CAST('-1' as INT2) as {{ alias }}
{%- elif datatype == 'BIGINT' or datatype == 'INT8' %} CAST('-1' as INT8) as {{ alias }}
{%- elif 'DECIMAL' in datatype or 'NUMERIC' in datatype %} CAST('-1' as {{ datatype }}) as {{ alias }}
{%- elif datatype == 'REAL' or datatype == 'FLOAT4' %} CAST('-1' as FLOAT4) as {{ alias }}
{%- elif datatype == 'DOUBLE PRECISION' or datatype == 'FLOAT' or datatype == 'FLOAT8' %} CAST('-1' as FLOAT) as {{ alias }}
{%- elif datatype == 'BOOLEAN' or datatype == 'BOOL' %} CAST('FALSE' as BOOLEAN) as {{ alias }}
{%- elif datatype == 'VARBYTE' or datatype == 'VARBINARY' or datatype == 'BINARY VARYING' %} CAST('{{ error_value__HASHTYPE }}' as {{ datatype }}) as "{{ alias }}"
{%- else %} CAST(NULL as {{ datatype }}) as {{ alias }}
{% endif %}
{%- else -%}
Expand Down
12 changes: 6 additions & 6 deletions macros/supporting/hash.sql
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -223,7 +223,7 @@
{%- endmacro -%}


{%- macro postgres__hash(columns, alias, is_hashdiff, multi_active_key, main_hashkey_column, rtrim_hashdiff) -%}
{%- macro postgres__hash(columns, alias, is_hashdiff, multi_active_key, main_hashkey_column) -%}


{%- set hash = var('datavault4dbt.hash', 'MD5') -%}
Expand Down Expand Up @@ -257,9 +257,9 @@
{%- if is_hashdiff and datavault4dbt.is_something(multi_active_key) -%}
{%- set std_dict = fromjson(datavault4dbt.multi_active_concattenated_standardise(case_sensitive=hashdiff_input_case_sensitive, hash_alg=hash_alg, datatype=hash_dtype, alias=alias, zero_key=unknown_key, multi_active_key=multi_active_key, main_hashkey_column=main_hashkey_column)) -%}
{%- elif is_hashdiff -%}
{%- set std_dict = fromjson(datavault4dbt.concattenated_standardise(case_sensitive=hashdiff_input_case_sensitive, hash_alg=hash_alg, datatype=hash_dtype, alias=alias, zero_key=unknown_key,is_hashdiff=is_hashdiff, rtrim_hashdiff=rtrim_hashdiff)) -%}
{%- set std_dict = fromjson(datavault4dbt.concattenated_standardise(case_sensitive=hashdiff_input_case_sensitive, hash_alg=hash_alg, datatype=hash_dtype, alias=alias, zero_key=unknown_key)) -%}
{%- else -%}
{%- set std_dict = fromjson(datavault4dbt.concattenated_standardise(case_sensitive=hashkey_input_case_sensitive, hash_alg=hash_alg, datatype=hash_dtype, alias=alias, zero_key=unknown_key,is_hashdiff=is_hashdiff, rtrim_hashdiff=rtrim_hashdiff)) -%}
{%- set std_dict = fromjson(datavault4dbt.concattenated_standardise(case_sensitive=hashkey_input_case_sensitive, hash_alg=hash_alg, datatype=hash_dtype, alias=alias, zero_key=unknown_key)) -%}
{%- endif -%}

{%- set standardise_prefix = std_dict['standardise_prefix'] -%}
Expand Down Expand Up @@ -295,7 +295,7 @@
{%- endmacro -%}


{%- macro redshift__hash(columns, alias, is_hashdiff, multi_active_key, main_hashkey_column, rtrim_hashdiff) -%}
{%- macro redshift__hash(columns, alias, is_hashdiff, multi_active_key, main_hashkey_column) -%}

{%- set hash = var('datavault4dbt.hash', 'MD5') -%}
{%- set concat_string = var('concat_string', '|') -%}
Expand Down Expand Up @@ -325,9 +325,9 @@
{%- if is_hashdiff and datavault4dbt.is_something(multi_active_key) -%}
{%- set std_dict = fromjson(datavault4dbt.multi_active_concattenated_standardise(case_sensitive=hashdiff_input_case_sensitive, hash_alg=hash_alg, datatype=hash_dtype, alias=alias, zero_key=unknown_key, multi_active_key=multi_active_key, main_hashkey_column=main_hashkey_column)) -%}
{%- elif is_hashdiff -%}
{%- set std_dict = fromjson(datavault4dbt.concattenated_standardise(case_sensitive=hashdiff_input_case_sensitive, hash_alg=hash_alg, datatype=hash_dtype, alias=alias, zero_key=unknown_key,is_hashdiff=is_hashdiff, rtrim_hashdiff=rtrim_hashdiff)) -%}
{%- set std_dict = fromjson(datavault4dbt.concattenated_standardise(case_sensitive=hashdiff_input_case_sensitive, hash_alg=hash_alg, datatype=hash_dtype, alias=alias, zero_key=unknown_key)) -%}
{%- else -%}
{%- set std_dict = fromjson(datavault4dbt.concattenated_standardise(case_sensitive=hashkey_input_case_sensitive, hash_alg=hash_alg, datatype=hash_dtype, alias=alias, zero_key=unknown_key,is_hashdiff=is_hashdiff, rtrim_hashdiff=rtrim_hashdiff)) -%}
{%- set std_dict = fromjson(datavault4dbt.concattenated_standardise(case_sensitive=hashkey_input_case_sensitive, hash_alg=hash_alg, datatype=hash_dtype, alias=alias, zero_key=unknown_key)) -%}
{%- endif -%}

{%- set standardise_prefix = std_dict['standardise_prefix'] -%}
Expand Down
8 changes: 4 additions & 4 deletions macros/supporting/hash_standardization.sql
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -40,13 +40,13 @@ CONCAT('\"', REPLACE(REPLACE(REPLACE(TRIM(CAST([EXPRESSION] AS STRING)), '\\', '
{%- endmacro -%}


{%- macro postgres__attribute_standardise() -%}
{%- macro postgres__attribute_standardise(hash_type) -%}

CONCAT('"', REPLACE(REGEXP_REPLACE(REGEXP_REPLACE(TRIM(BOTH ' ' FROM CAST([EXPRESSION] AS VARCHAR)), '\\', '\\\\'), '[QUOTE]', '\"'), '[NULL_PLACEHOLDER_STRING]', '--'), '"')

{%- endmacro -%}

{%- macro redshift__attribute_standardise() -%}
{%- macro redshift__attribute_standardise(hash_type) -%}

'"' || REPLACE(REPLACE(REPLACE(TRIM(BOTH ' ' FROM [EXPRESSION]), '\\', '\\\\'), '[QUOTE]', '\\"'), '[NULL_PLACEHOLDER_STRING]', '--') || '"'

Expand Down Expand Up @@ -196,7 +196,7 @@ CONCAT('"', REPLACE(REGEXP_REPLACE(REGEXP_REPLACE(TRIM(BOTH ' ' FROM CAST([EXPRE

{%- endmacro -%}

{%- macro postgres__concattenated_standardise(case_sensitive, hash_alg, datatype, zero_key, alias,is_hashdiff, rtrim_hashdiff) -%}
{%- macro postgres__concattenated_standardise(case_sensitive, hash_alg, datatype, zero_key, alias) -%}

{%- set dict_result = {} -%}

Expand Down Expand Up @@ -238,7 +238,7 @@ CONCAT('"', REPLACE(REGEXP_REPLACE(REGEXP_REPLACE(TRIM(BOTH ' ' FROM CAST([EXPRE

{%- endmacro -%}

{%- macro redshift__concattenated_standardise(case_sensitive, hash_alg, datatype, zero_key, alias,is_hashdiff, rtrim_hashdiff) -%}
{%- macro redshift__concattenated_standardise(case_sensitive, hash_alg, datatype, zero_key, alias) -%}

{%- set dict_result = {} -%}

Expand Down
2 changes: 1 addition & 1 deletion macros/tables/postgres/control_snap_v0.sql
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
{%- macro postgres__control_snap_v0(start_date, daily_snapshot_time, sdts_alias) -%}
{%- macro postgres__control_snap_v0(start_date, daily_snapshot_time, sdts_alias, end_date=none) -%}

{%- set timestamp_format = datavault4dbt.timestamp_format() -%}

Expand Down
2 changes: 1 addition & 1 deletion macros/tables/postgres/ref_sat_v0.sql
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
{%- macro postgres__ref_sat_v0(parent_ref_keys, src_hashdiff, src_payload, src_ldts, src_rsrc, source_model) -%}
{%- macro postgres__ref_sat_v0(parent_ref_keys, src_hashdiff, src_payload, src_ldts, src_rsrc, source_model, disable_hwm, source_is_single_batch) -%}

{%- set beginning_of_all_times = datavault4dbt.beginning_of_all_times() -%}
{%- set end_of_all_times = datavault4dbt.end_of_all_times() -%}
Expand Down
1 change: 1 addition & 0 deletions macros/tables/postgres/ref_sat_v1.sql
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,6 +4,7 @@
{%- set timestamp_format = datavault4dbt.timestamp_format() -%}

{%- set is_current_col_alias = var('datavault4dbt.is_current_col_alias', 'IS_CURRENT') -%}
{%- set ledts_alias = var('datavault4dbt.ledts_alias', 'ledts') -%}

{%- set source_relation = ref(ref_sat_v0) -%}

Expand Down
2 changes: 1 addition & 1 deletion macros/tables/postgres/sat_v0.sql
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
{%- macro postgres__sat_v0(parent_hashkey, src_hashdiff, src_payload, src_ldts, src_rsrc, source_model) -%}
{%- macro postgres__sat_v0(parent_hashkey, src_hashdiff, src_payload, src_ldts, src_rsrc, source_model, disable_hwm, source_is_single_batch) -%}

{%- set beginning_of_all_times = datavault4dbt.beginning_of_all_times() -%}
{%- set end_of_all_times = datavault4dbt.end_of_all_times() -%}
Expand Down
2 changes: 1 addition & 1 deletion macros/tables/redshift/control_snap_v0.sql
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
{%- macro redshift__control_snap_v0(start_date, daily_snapshot_time, sdts_alias) -%}
{%- macro redshift__control_snap_v0(start_date, daily_snapshot_time, sdts_alias, end_date=none) -%}

{%- set timestamp_format = datavault4dbt.timestamp_format() -%}

Expand Down
2 changes: 1 addition & 1 deletion macros/tables/redshift/ref_sat_v0.sql
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
{%- macro redshift__ref_sat_v0(parent_ref_keys, src_hashdiff, src_payload, src_ldts, src_rsrc, source_model) -%}
{%- macro redshift__ref_sat_v0(parent_ref_keys, src_hashdiff, src_payload, src_ldts, src_rsrc, source_model, disable_hwm, source_is_single_batch) -%}

{%- set beginning_of_all_times = datavault4dbt.beginning_of_all_times() -%}
{%- set end_of_all_times = datavault4dbt.end_of_all_times() -%}
Expand Down
1 change: 1 addition & 0 deletions macros/tables/redshift/ref_sat_v1.sql
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,6 +4,7 @@
{%- set timestamp_format = datavault4dbt.timestamp_format() -%}

{%- set is_current_col_alias = var('datavault4dbt.is_current_col_alias', 'IS_CURRENT') -%}
{%- set ledts_alias = var('datavault4dbt.ledts_alias', 'ledts') -%}

{%- set source_relation = ref(ref_sat_v0) -%}

Expand Down
2 changes: 1 addition & 1 deletion macros/tables/redshift/sat_v0.sql
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
{%- macro redshift__sat_v0(parent_hashkey, src_hashdiff, src_payload, src_ldts, src_rsrc, source_model) -%}
{%- macro redshift__sat_v0(parent_hashkey, src_hashdiff, src_payload, src_ldts, src_rsrc, source_model, disable_hwm, source_is_single_batch) -%}

{%- set beginning_of_all_times = datavault4dbt.beginning_of_all_times() -%}
{%- set end_of_all_times = datavault4dbt.end_of_all_times() -%}
Expand Down