This project implements a Lakehouse Medallion Architecture using modern Data Stack tools such as Fivetran, Snowflake and dbt. The ficticious organization is an e-commerce company.
-
Updated
Jan 24, 2024 - Python
#
medallion-architecture
Here are 7 public repositories matching this topic...
docker
data-science
kafka
docker-compose
zookeeper
tsql
mssqlserver
dremio
gitpod
ksqldb
lakehouse
medallion-architecture
-
Updated
Sep 20, 2022 - TSQL
In this project, we setup and end to end data engineering using Apache Spark, Azure Databricks, Data Build Tool (DBT) using Azure as our cloud provider.
-
Updated
May 21, 2024
Data Warehouse with ELT pipelines
-
Updated
Dec 31, 2023 - Python
Além de explorar boas práticas em python, o propósito é de aplicar conceitos de Arquitetura Medallion, programação orientada a objetos e ETL, utilizando dados públicos sociais dos municípios brasileiros. Este repositório utiliza ainda DuckDB e Streamlit para exibição dos resultados
python
r
plotly
pandas
tax
gdp
parquet
folium
ols-regression
anova
ipea
geopandas
tributos
pib
hdi
ipeadata
streamlit
duckdb
idh
medallion-architecture
-
Updated
Jun 27, 2024 - Python
Implemented enhanced analytics for trip transactions and ride-based data from SQL Server using Medallion Architecture with Azure Data Factory and Databricks.
-
Updated
Jan 9, 2024 - Jupyter Notebook
This repository contains a comprehensive end-to-end Azure Data Engineering solution, covering the entire data lifecycle from ingestion to reporting. The project utilizes various Azure services and tools to achieve efficient data handling, transformation, and reporting.
-
Updated
Jun 28, 2024 - Python
Improve this page
Add a description, image, and links to the medallion-architecture topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the medallion-architecture topic, visit your repo's landing page and select "manage topics."