Yelp Beam (Sky Beam)

Command to Trigger

python -m sky_beam.main
--runner DataflowRunner
--folder_name
--temp_location
--project
--region

Stack

• technologies used:
  • Python
  • Apache Beam
  • Google Cloud Dataflow
  • Google Cloud BigQuery
  • Google Cloud Storage
  • GitHub Actions (black formatter, isort, flake8, GitGuardian community action)

Accompanying Blog post located here