Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Alpakka connector for Azure Storage #3253

Open
sfali opened this issue Aug 22, 2024 · 1 comment
Open

Alpakka connector for Azure Storage #3253

sfali opened this issue Aug 22, 2024 · 1 comment
Labels
p:new

Comments

@sfali
Copy link
Contributor

sfali commented Aug 22, 2024

Short description

Alpakka connector for Azure Storage

Details

There is no connector for Azure Storage (which works same way as AWS S3). We need this connector for one of our project.

Do you mind if I start this connector with basic functionality.

Regards,

Syed
sfali added a commit to sfali/alpakka that referenced this issue Aug 23, 2024
@sfali
Setting up module for Azure storage akka#3253
06eac15
sfali added a commit to sfali/alpakka that referenced this issue Aug 23, 2024
@sfali
Azure storage common settings akka#3253
42b8505
sfali added a commit to sfali/alpakka that referenced this issue Aug 23, 2024
@sfali
Some common functions akka#3253
4412dec
sfali added a commit to sfali/alpakka that referenced this issue Aug 23, 2024
@sfali
Supporting model classes akka#3253
dc26cea
sfali added a commit to sfali/alpakka that referenced this issue Aug 23, 2024
@sfali
Exception representing returned error akka#3253
882afcd 
It parses the returned XML and populate StorageException
sfali added a commit to sfali/alpakka that referenced this issue Aug 23, 2024
@sfali
Helper class to sign and populate Authorization header akka#3253
5a8728e 
1. Populates required date and version header
2. Reads current request and create authorization token as per AWS requirements
3. Populates authorization header
sfali added a commit to sfali/alpakka that referenced this issue Aug 23, 2024
@sfali
Implementation of Azure storage functions akka#3253
3616c5f 
Current implementation only supports Blob and File services.
Currently supported functions:
1. Get blob and file
2. Put blob
3. Create file
3. Put range
4. Clear range
5. Delete blob and file
6. Get blob and file properties
sfali added a commit to sfali/alpakka that referenced this issue Aug 23, 2024
@sfali
Scala and Java facade to implementation akka#3253
7626390
sfali added a commit to sfali/alpakka that referenced this issue Aug 24, 2024
@sfali
Introducing Akka stream attributes in order to configure http request a…
f1de209 
…kka#3253
sfali added a commit to sfali/alpakka that referenced this issue Aug 24, 2024
@sfali
Resolve settings from Akka stream attributes akka#3253
426b800
sfali added a commit to sfali/alpakka that referenced this issue Aug 24, 2024
@sfali
Added support for SharedKeyLite authorization akka#3253
e41869e
sfali added a commit to sfali/alpakka that referenced this issue Aug 24, 2024
@sfali
Added support for SAS authorization akka#3253
5d3b55d
sfali added a commit to sfali/alpakka that referenced this issue Aug 24, 2024
@sfali
use option for null String akka#3253
dcc9c21
sfali added a commit to sfali/alpakka that referenced this issue Aug 24, 2024
@sfali
function to get default settings akka#3253
582edb3
sfali added a commit to sfali/alpakka that referenced this issue Aug 24, 2024
@sfali
Support for SAS authorization akka#3253
7dd77c6 
1. Create query string with SAS token
2. Initialize query string
sfali added a commit to sfali/alpakka that referenced this issue Aug 24, 2024
@sfali
Splitting service operations based on service type akka#3253
d29f3f9
sfali added a commit to sfali/alpakka that referenced this issue Aug 24, 2024
@sfali
Splitting service operations based on service type akka#3253
997746a
sfali added a commit to sfali/alpakka that referenced this issue Aug 25, 2024
@sfali
StorageException test akka#3253
34832f6
sfali added a commit to sfali/alpakka that referenced this issue Aug 25, 2024
@sfali
creating constants for authorization types akka#3253
6cc3254
sfali added a commit to sfali/alpakka that referenced this issue Aug 25, 2024
@sfali
implicit class to handle validations akka#3253
d51c06a
sfali added a commit to sfali/alpakka that referenced this issue Aug 25, 2024
@sfali
validations of configs and falling back to default values akka#3253
7b3ed57
sfali added a commit to sfali/alpakka that referenced this issue Aug 25, 2024
@sfali
StorageSettings tests akka#3253
07e64a5
@ennru ennru added the p:new label Aug 26, 2024
@ennru
Copy link
Member

ennru commented Aug 26, 2024

Sounds great, please go ahead.
Reach out if you need assistance.

sfali added a commit to sfali/alpakka that referenced this issue Aug 27, 2024
@sfali
support for create container operation akka#3253
44c2f84
sfali added a commit to sfali/alpakka that referenced this issue Aug 27, 2024
@sfali
support for endpoint URL for local testing akka#3253
93c2aab
sfali added a commit to sfali/alpakka that referenced this issue Aug 27, 2024
@sfali
using end point if defined to create URI akka#3253
7ac0aa4
sfali added a commit to sfali/alpakka that referenced this issue Aug 27, 2024
@sfali
move signer out of retry flow, we don't need to sign every time akka#…
9f013cb 
…3253
sfali added a commit to sfali/alpakka that referenced this issue Aug 27, 2024
@sfali
copy right header akka#3253
9b81f84
sfali added a commit to sfali/alpakka that referenced this issue Aug 27, 2024
@sfali
pass implicit ActorSystem akka#3253
3ad11ea
sfali added a commit to sfali/alpakka that referenced this issue Aug 28, 2024
@sfali
extracted some constants to be used in sub classes akka#3253
b8600fc
sfali added a commit to sfali/alpakka that referenced this issue Aug 28, 2024
@sfali
FileService test akka#3253
be29661
sfali added a commit to sfali/alpakka that referenced this issue Aug 29, 2024
@sfali
introducing factory class to create headers akka#3253
49deaae
sfali added a commit to sfali/alpakka that referenced this issue Aug 29, 2024
@sfali
updated implementation to get headers from dsl akka#3253
cf48d55 
1. DSL to create headers based on function and pass it to implementation
2. Remove "bobType" from "putBlob", separate functions will be introduced for page and append blocks
sfali added a commit to sfali/alpakka that referenced this issue Aug 29, 2024
@sfali
rename "putBlob" to "putBlockBlob" akka#3253
c10b3d1
sfali added a commit to sfali/alpakka that referenced this issue Aug 29, 2024
@sfali
functions to put (create) page and append block akka#3253
96601a8
sfali added a commit to sfali/alpakka that referenced this issue Aug 29, 2024
@sfali
unit tests for put (create) page and append block akka#3253
a4e0687
sfali added a commit to sfali/alpakka that referenced this issue Aug 29, 2024
@sfali
fix return types akka#3253
dc22e08
sfali added a commit to sfali/alpakka that referenced this issue Aug 29, 2024
@sfali
rename in order to accommodate page blob header akka#3253
562950e
sfali added a commit to sfali/alpakka that referenced this issue Aug 29, 2024
@sfali
fix compilation akka#3253
e90a717
sfali added a commit to sfali/alpakka that referenced this issue Aug 29, 2024
@sfali
Headers for page blob update akka#3253
70466ce 
1. Rename file write header
2. Added header for page blob for future implementation
sfali added a commit to sfali/alpakka that referenced this issue Aug 29, 2024
@sfali
updated rename field akka#3253
f167907
sfali added a commit to sfali/alpakka that referenced this issue Aug 29, 2024
@sfali
extracted common function and delegate all functions to this common f…
c750818 
…unction akka#3253
sfali added a commit to sfali/alpakka that referenced this issue Aug 29, 2024
@sfali
clean up, headers move to separate class akka#3253
c8afd96
sfali added a commit to sfali/alpakka that referenced this issue Aug 29, 2024
@sfali
fix compiler warning akka#3253
ba27834
sfali added a commit to sfali/alpakka that referenced this issue Aug 29, 2024
@sfali
using ScalaIgnore akka#3253
31bdf55
sfali added a commit to sfali/alpakka that referenced this issue Aug 29, 2024
@sfali
fix link akka#3253
d1b5410
sfali added a commit to sfali/alpakka that referenced this issue Aug 31, 2024
@sfali
introduction of request builder akka#3253
9882881 
1. support for SSE and additional headers in StorageRequest
2. introducing request builder and builder for each request
3. update Scala and Java API to use request builder
4. update implementation to use request builder
5. update tests
6.tests for request builder
7. update documentation
sfali added a commit to sfali/alpakka that referenced this issue Aug 31, 2024
@sfali
test for loading settings from custom path akka#3253
9358d5e 
1. don't throw RuntimeException, it fails to load config from custom path
2. clean up configs
sfali added a commit to sfali/alpakka that referenced this issue Aug 31, 2024
@sfali
remove unused import akka#3253
2a0220b
sfali added a commit to sfali/alpakka that referenced this issue Sep 2, 2024
@sfali
Signer spec akka#3253
9329318 
1. add implicit clock in order to test date
2. add test dependency to storage common in order to test authorization header
3. change to lower case as per Azure storage specification
4. handling of empty query
sfali added a commit to sfali/alpakka that referenced this issue Sep 4, 2024
@sfali
Fix for multiple content length header akka#3253
e770b53 
1. Filter WireMock request for multiple content-length headers
2. fix typo in test
sfali added a commit to sfali/alpakka that referenced this issue Sep 5, 2024
@sfali
Clean up duplicate code akka#3253
1cbb77e 
1. Move logic to execute rest call to generic `handleRequest` function
2. Introduce functions each operation and delegate call to `handleRequest`
3. Service APIs to call explicit function
sfali added a commit to sfali/alpakka that referenced this issue Sep 7, 2024
@sfali
Add more test akka#3253
da8d82f
sfali added a commit to sfali/alpakka that referenced this issue Sep 7, 2024
@sfali
remove support for SharedKeyLite akka#3253
9fb81d1
sfali added a commit to sfali/alpakka that referenced this issue Sep 10, 2024
@sfali
Fail safe error message akka#3253
948db31 
1. Make sure we don't emit empty string
2. correct configuration
sfali added a commit to sfali/alpakka that referenced this issue Sep 11, 2024
@sfali
Delete Container support akka#3253
689cd53 
1. Request builder for delete container
2. Implementation of delete container and Scala and Java API
3. Tests for delete container
4. Documentation
sfali added a commit to sfali/alpakka that referenced this issue Sep 11, 2024
@sfali
Create & Delete directory support akka#3253
d6d9ed0 
1. Request builder for create & delete directories
2. Implementation of create & delete directories and Scala and Java API
3. Tests for create & delete directories
4. Documentation
sfali added a commit to sfali/alpakka that referenced this issue Sep 30, 2024
@sfali
fix import akka#3253
43f347f
sebastian-alfers pushed a commit that referenced this issue Oct 3, 2024
@sfali @girdharshubham
Azure Storage: Azure storage support #3253 (#3254)
4049dca 
* Setting up module for Azure storage #3253

---------

Co-authored-by: Shubham Girdhar <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
p:new
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@ennru @sfali