In this phase describes the details of following steps to:
- Create Azure storage account
- Create a blob container in storage account
- Generate Shared Access Signature to use as a credential when connecting to the storage account
- Load files from Github to storage account using Azure Cloud Shell
- (Optional)Connect Azure Storage Explorer to the storage account to browse files.
After loging to Azure platform, navagate to Storage Accounts to create one storage account
Click on "Go to Resources"
Go to container under Data Storage
Click on +Create, provide the container name as "Lab-data" and click "Create" button.
For the container lab-data generate SAS key by clicking on "Generate SAS"
Ater clicking button, the following page opens
Click on "SAS Token and URL" button.
Copy the generated SAS Key and URL for further use, which will be used for authenticating and loading data into this container.
The URL for the script file to run is provided in the prequisites of this page.
Open Azure cloud shell and upload the file into the cloud shell folder as shown below
Once the file is uploaded when we execute "ls -l" we can find the uploaded file in the cloud folder as shown below
To open the file in the terminal use code followed by the file name as shown below.
Open the script in visual studio and place the token and hostname saved previously and repeat step four (4). when user types code followed by file name the result will be as follows.
To Run the script type bash followed by filename as belown and the data from bithub repository gets populated into the blob container.
This will take around one hour to load the data into container. once this operation is done we can move further to load this data into Snowflake warehouse.
Azure Storage Explorer is a free tool that lets you manage cloud storage resources from your desktop
Enter the "Blob SAS URL" that was generated in 4.3 above. The Display name should default to "lab-data" (unless you changed the container name). Click "Next" and then "Connect" on the next screen.
You should now see the files that were loaded into the storage account
Download this file to load the script file into Azure cloud shell and run: lab-snowflake-powerbi-load-to-azure-blob.sh
To explore in detailed about snowflake, please refer to the following URL: https://docs.snowflake.com/en/user-guide/intro-key-concepts