Skip to content
/ Spark_Multi_Cloud_Storage_Utils Public

Spark Read/Write data from/to Multi Cloud utils (GCP, Azure and AWS)

0 stars 0 forks Branches Tags Activity
Star
Notifications You must be signed in to change notification settings

anjijava16/Spark_Multi_Cloud_Storage_Utils

BranchesTags

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

71 Commits
AWS
AWS
 
 
Azure
Azure
 
 
Databricks
Databricks
 
 
GCP
GCP
 
 
README.md
README.md
 
 

Repository files navigation

Spark_Multi_Cloud_Storage_Utils

Spark Read data from Multi Cloud Utils(GCP,Azure and AWS)

  1. In this repo Read data from Spark with AWS S3,GCS Storage and Azure Data Lake FS
  2. In this repo Write data into Spark with AWS S3,GCS Storage and Azure Data Lake FS

Pre-Requests

  1. AWS Account
  2. GCP Account
  3. Azure Account

Input Source

  1. AWS S3
  2. Google GCS Storage
  3. Azure Storage (Data lake Gen2)

Output Source

  1. AWS S3
  2. Google GCS Storage
  3. Azure Storage (Data lake Gen2)

About

Spark Read/Write data from/to Multi Cloud utils (GCP, Azure and AWS)

Topics

bigquery aws azure aws-s3 gcp redshift azure-storage azure-data-lake gcp-storage azure-synapse

Resources

Readme
Activity

Stars

0 stars

Watchers

2 watching

Forks

0 forks
Report repository

Releases

No releases published

Packages

No packages published

Languages