Releases: fivetran/dbt_sap
Releases · fivetran/dbt_sap
v0.3.1 dbt_sap
PR #36 includes the following updates:
Documentation
- Updated the following column descriptions within the sap__0fi_gl10 model:
accumulated_balance
andturnover
.accumulated_balance
andturnover
are both initially derived from the hslvt, tslvt, kslvt, and oslvt fields. They represent the balance carried forward from the previous fiscal year and are identical at the beginning of the first fiscal period. However, they diverge as subsequent transactions occur.- hslvt, tslvt, kslvt, and oslvt are intentionally duplicated and aliased as hsmvt, tsmvt, ksmvt, and osmvt for legacy compatibility purposes.
Full Changelog: v0.3.0...v0.3.1
v0.3.0 dbt_sap
PR #34 includes the following updates:
Schema and Data Changes (--full-refresh required after upgrading)
97 total changes • 94 of which are breaking in the form of materialization updates
Data Model | Change type | Old | New | Notes |
---|---|---|---|---|
stg_* (all staging models: 72) | Materialization | Table | View | These staging models are now views. Upon full refresh, the package should automatically drop the tables and recreate them as views. However, we recommend reviewing your schema and manually dropping any remaining staging models materialized as tables as they will no longer be updated in favor of the materialized views. |
int_* (all sales and procurement intermediate models: 22) | Materialization | Table | Ephemeral | These intermediate models are now views. We therefore recommend manually dropping all sap data model sales and procurement intermediate tables as they will no longer be updated in favor of the materialized views. |
dbt Fusion Compatibility Updates
- Updated package to maintain compatibility with dbt-core versions both before and after v1.10.6, which introduced a breaking change to multi-argument test syntax (e.g.,
unique_combination_of_columns
). - Temporarily removed unsupported tests to avoid errors and ensure smoother upgrades across different dbt-core versions. These tests will be reintroduced once a safe migration path is available.
- Removed all
dbt_utils.unique_combination_of_columns
tests. - Moved
loaded_at_field: _fivetran_synced
under theconfig:
block insrc_sap.yml
- Removed all
Full Changelog: v0.2.1...v0.3.0
v0.2.1 dbt_sap
PR #28 includes the following updates:
Under the Hood
- Updated the
table_variables
to uppercase source names, aligning with how they're represented in the Fivetran connector schema. This ensures the variables resolve correctly.
Full Changelog: v0.2.0...v0.2.1
v0.2.1-a1 dbt_sap
PR #28 includes the following updates:
Under the Hood
- Updated
table_variables
to capitalize source names, aligning with how they're represented in the connector schema. This ensures the variables resolve correctly.
Full Changelog: v0.2.0...v0.2.1-a1
v0.2.0 dbt_sap
PR #25 includes the following updates:
Schema & Data Updates
75 total changes • 4 possible breaking changes.
Data Model | Change Type | Old Name | New Name | Notes |
---|---|---|---|---|
stg_sap__lfa1 |
New columns | Refer to the linked documentation for the full column list. | ||
stg_sap__mara |
New columns | Refer to the linked documentation for the full column list. | ||
stg_sap__t001 |
New columns | Refer to the linked documentation for the full column list. | ||
stg_sap__t001w |
New columns | Refer to the linked documentation for the full column list. | ||
sap__dim_customer |
New model | Dimension model for SAP customers (kna1 ). |
||
sap__dim_material |
New model | Dimension model for SAP materials (mara ). |
||
sap__dim_plant |
New model | Dimension model for SAP plants (t001w ). |
||
sap__dim_purchasing_order |
New model | Dimension model for purchasing orders (ekko ). |
||
sap__dim_purchasing_organization |
New model | Dimension model for purchasing organizations (t024e ). |
||
sap__dim_rejection_reason |
New model | Dimension model for sales order rejection reasons (tvag ). |
||
sap__dim_vendor |
New model | Dimension model for vendors (lfa1 ). |
||
sap__fact_purchasing_order |
New model | Fact model for purchasing order data (ekko , ekpo , eket ). |
||
sap__fact_sales_order |
New model | Fact model for sales order data (vbak , vbap ). |
||
int_sap__company |
New model | Intermediate model for companies (t001 ). |
||
int_sap__customer |
New model | Intermediate model for customers (kna1 ). |
||
int_sap__material |
New model | Intermediate model for materials (mara ). |
||
int_sap__material_type |
New model | Intermediate model for material types (t134 ). |
||
int_sap__plant |
New model | Intermediate model for plants (t001w ). |
||
int_sap__purchasing_document_category |
New model | Intermediate model for purchasing doc categories (dd07l ). |
||
int_sap__purchasing_document_header |
New model | Intermediate model for purchasing document headers (ekko ). |
||
int_sap__purchasing_document_history |
New model | Intermediate model for purchasing document history (ekbe ). |
||
int_sap__purchasing_document_item |
New model | Intermediate model for purchasing document items (ekpo ). |
||
int_sap__purchasing_document_overview |
New model | Intermediate model for rollup of int_sap__purchasing_document_history . |
||
int_sap__purchasing_document_schedule_line |
New model | Intermediate model for purchasing schedules (eket ). |
||
int_sap__purchasing_document_schedule_total |
New model | Intermediate model for rollup of int_sap__purchasing_document_schedule_line . |
||
int_sap__purchasing_document_status |
New model | Intermediate model for purchasing document statuses (dd07l ). |
||
int_sap__purchasing_document_type |
New model | Intermediate model for purchasing doc types (t161 ). |
||
int_sap__purchasing_group |
New model | Intermediate model for purchasing groups (t024 ). |
||
int_sap__purchasing_organization |
New model | Intermediate model for purchasing organizations (t024e ). |
||
int_sap__sales_document_header |
New model | Intermediate model for sales document headers (vbak ). |
||
int_sap__sales_document_header_status |
New model | Intermediate model for sales doc header statuses (vbuk ). |
||
int_sap__sales_document_item |
New model | Intermediate model for sales document items (vbap ). |
||
int_sap__sales_document_item_status |
New model | Intermediate model for sales doc item statuses (vbup ). |
||
int_sap__sales_document_rejection_reason |
New model | Intermediate model for sales rejection reasons (tvag ). |
||
int_sap__vendor |
New model | Intermediate model for vendors (lfa1 ). |
||
stg_sap__dd07l |
New model | Staging model for domain values (dd07l ). |
||
stg_sap__dd07t |
New model | Staging model for domain value descriptions (dd07t ). |
||
stg_sap__ekbe |
New model | Staging model for purchasing document history (ekbe ). |
||
stg_sap__eket |
New model | Staging model for purchasing schedule lines (eket ). |
||
stg_sap__ekko |
New model | Staging model for purchasing document headers (ekko ). |
||
stg_sap__ekpo |
New model | Staging model for purchasing document items (ekpo ). |
||
stg_sap__makt |
New model | Staging model for material descriptions (makt ). |
||
stg_sap__t001w |
New model | Staging model for plants (t001w ). |
||
stg_sap__t024 |
New model | Staging model for purchasing groups (t024 ). |
||
stg_sap__t024e |
New model | Staging model for purchasing organizations (t024e ). |
||
stg_sap__t134 |
New model | Staging model for material types (t134 ). |
||
stg_sap__t134t |
New model | Staging model for material type descriptions (t134t ). |
||
stg_sap__t161 |
New model | Staging model for purchasing document types (t161 ). |
||
stg_sap__t161t |
New model | Staging model for purchasing document type descriptions (t161t ). |
||
stg_sap__tvag |
New model | Staging model for sales document rejection reasons (tvag ). |
||
stg_sap__tvagt |
New model | Staging model for rejection reason descriptions (tvagt ). |
||
stg_sap__vbak |
New model | Staging model for sales document headers (vbak ). |
||
stg_sap__vbap |
New model | Staging model for sales document items (vbap ). |
||
[stg_sap__vbuk ](https://fivet... |
v0.1.0 dbt_sap
🎉 New dbt SAP package! 🎉
This is the initial release of the SAP package!
📣 What does this dbt package do?
- Provides recreations of the SAP extractor models to enable you to better understand your SAP data. The package achieves this by performing the following:
- Brings in essential master attribute tables like Company Code (
sap__0comp_code_attr
), Customer Master (sap__0customer_attr
), Employee (sap__0employee_attr
), G/L Account Number (sap__0gl_account_attr
), Material Data (sap__0material_attr
), and Vendor Number (sap__0vendor_attr
). - Brings in general ledger models like General Ledger: Balances, Leading Ledger (
sap__0fi_gl_10
) and Line Items Leading Ledger (sap__0fi_gl_14
). - Brings in master text models like Company Code (
sap__0comp_code_text
), Company (sap__0company_text
), and Vendor (sap__0vendor_text
).
- Brings in essential master attribute tables like Company Code (
- Produces modeled tables that leverage SAP data from Fivetran's SAP connectors, like LDP SAP Netweaver, HVA SAP ECC or SAP ERP on HANA and build off the output of our SAP source package.
- Generates a comprehensive data dictionary of your source and modeled sap data through the dbt docs site.
- Currently the package supports Postgres, Redshift, BigQuery, Databricks, and Snowflake. Additionally, this package is designed to work with dbt versions [">=1.3.0", "<2.0.0"].
For more information, refer to the README.
Submit any feedback you have here in our survey, post in our Fivetran dbt community with questions you might have, or submit any issues you encounter with our package within Github if you need any additional help!