Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[FEAT] S3 to Redshift script #119

Closed
4 of 5 tasks
srlee056 opened this issue Feb 29, 2024 · 0 comments · Fixed by #129
Closed
4 of 5 tasks

[FEAT] S3 to Redshift script #119

srlee056 opened this issue Feb 29, 2024 · 0 comments · Fixed by #129
Labels
Data ETL glue
Milestone
sprint6(02.29~03.02)

Comments

@srlee056
Copy link
Contributor

srlee056 commented Feb 29, 2024 •
edited
Loading

Description

각 parquet별로 redshift에 적재하는 부분 glue job script에 추가
Redshift spectrum 사용으로 해결됨

###checklist

  • add glue crawler to glue job dags
  • glue follower
  • glue game_ccu
  • glue game_price
  • glue game_rating
  • glue live_viewer
@srlee056 srlee056 added this to the sprint6(02.29~03.02) milestone Feb 29, 2024
@srlee056 srlee056 closed this as completed Mar 4, 2024
@github-project-automation github-project-automation bot moved this from Backlog to Done in zhzzic_kanban Mar 4, 2024
@srlee056 srlee056 reopened this Mar 4, 2024
@github-project-automation github-project-automation bot moved this from Done to In progress in zhzzic_kanban Mar 4, 2024
@srlee056 srlee056 mentioned this issue Mar 5, 2024
Merged
4 tasks
@github-project-automation github-project-automation bot moved this from In progress to Done in zhzzic_kanban Mar 5, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
Data ETL glue
Projects
zhzzic_kanban
Status: Done
Milestone
sprint6(02.29~03.02)
Development

Successfully merging a pull request may close this issue.

Feature/glue crawler zizzic/airflow_repo
2 participants
@poriz @srlee056